Apr 14 15:32:21 user nova-compute[71500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 15:32:23 user nova-compute[71500]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71500) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 15:32:23 user nova-compute[71500]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71500) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 15:32:23 user nova-compute[71500]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71500) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 15:32:23 user nova-compute[71500]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 15:32:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:32:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:32:24 user nova-compute[71500]: INFO nova.virt.driver [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 15:32:24 user nova-compute[71500]: INFO nova.compute.provider_config [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Acquiring lock "singleton_lock" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Acquired lock "singleton_lock" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Releasing lock "singleton_lock" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Full set of CONF: {{(pid=71500) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ******************************************************************************** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Configuration options gathered from: {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ================================================================================ {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] allow_resize_to_same_host      = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] arq_binding_timeout            = 300 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] backdoor_port                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] backdoor_socket                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] block_device_allocate_retries  = 300 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] block_device_allocate_retries_interval = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cert                           = self.pem {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute_monitors               = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] config_dir                     = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] config_drive_format            = iso9660 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] config_source                  = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] console_host                   = user {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] control_exchange               = nova {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cpu_allocation_ratio           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] daemon                         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] debug                          = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] default_access_ip_network_name = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] default_availability_zone      = nova {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] default_ephemeral_format       = ext4 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] default_schedule_zone          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] disk_allocation_ratio          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] enable_new_services            = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] enabled_ssl_apis               = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] flat_injected                  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] force_config_drive             = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] force_raw_images               = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] graceful_shutdown_timeout      = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] heal_instance_info_cache_interval = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] host                           = user {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_build_timeout         = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_delete_interval       = 300 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_name_template         = instance-%08x {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_usage_audit           = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_usage_audit_period    = month {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] internal_service_availability_zone = internal {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] key                            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] live_migration_retry_count     = 30 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_config_append              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_dir                        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_file                       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_options                    = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_rotate_interval            = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_rotate_interval_type       = days {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] log_rotation_type              = none {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] long_rpc_timeout               = 1800 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] max_concurrent_builds          = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] max_concurrent_live_migrations = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] max_concurrent_snapshots       = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] max_local_block_devices        = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] max_logfile_count              = 30 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] max_logfile_size_mb            = 200 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] maximum_instance_delete_attempts = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metadata_listen                = 0.0.0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metadata_listen_port           = 8775 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metadata_workers               = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] migrate_max_retries            = -1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] mkisofs_cmd                    = genisoimage {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] my_ip                          = 10.0.0.210 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] network_allocate_retries       = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] osapi_compute_listen_port      = 8774 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] osapi_compute_unique_server_name_scope =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] osapi_compute_workers          = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] password_length                = 12 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] periodic_enable                = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] periodic_fuzzy_delay           = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] pointer_model                  = ps2mouse {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] preallocate_images             = none {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] publish_errors                 = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] pybasedir                      = /opt/stack/nova {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ram_allocation_ratio           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rate_limit_burst               = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rate_limit_except_level        = CRITICAL {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rate_limit_interval            = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reboot_timeout                 = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reclaim_instance_interval      = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] record                         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reimage_timeout_per_gb         = 20 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] report_interval                = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rescue_timeout                 = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reserved_host_cpus             = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reserved_host_disk_mb          = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reserved_host_memory_mb        = 512 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] reserved_huge_pages            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] resize_confirm_window          = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] resize_fs_using_block_device   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] resume_guests_state_on_host_boot = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rpc_response_timeout           = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] run_external_periodic_tasks    = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] running_deleted_instance_action = reap {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] running_deleted_instance_timeout = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler_instance_sync_interval = 120 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_down_time              = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] servicegroup_driver            = db {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] shelved_offload_time           = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] shelved_poll_interval          = 3600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] shutdown_timeout               = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] source_is_ipv6                 = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ssl_only                       = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] state_path                     = /opt/stack/data/nova {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] sync_power_state_interval      = 600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] sync_power_state_pool_size     = 1000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] syslog_log_facility            = LOG_USER {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] tempdir                        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] timeout_nbd                    = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] transport_url                  = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] update_resources_interval      = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_cow_images                 = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_eventlog                   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_journal                    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_json                       = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_rootwrap_daemon            = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_stderr                     = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] use_syslog                     = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vcpu_pin_set                   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plugging_is_fatal          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plugging_timeout           = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] virt_mkfs                      = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] volume_usage_poll_interval     = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] watch_log_file                 = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] web                            = /usr/share/spice-html5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_concurrency.disable_process_locking = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.auth_strategy              = keystone {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.compute_link_prefix        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.dhcp_domain                = novalocal {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.enable_instance_password   = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.glance_link_prefix         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.instance_list_per_project_cells = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.list_records_by_skipping_down_cells = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.local_metadata_per_cell    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.max_limit                  = 1000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.metadata_cache_expiration  = 15 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.neutron_default_tenant_id  = default {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.use_forwarded_for          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.use_neutron_default_nets   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_dynamic_targets = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_jsonfile_path   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.backend_argument         = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.config_prefix            = cache.oslo {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.dead_timeout             = 60.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.debug_cache_backend      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.enable_retry_client      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.enable_socket_keepalive  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.enabled                  = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.expiration_time          = 600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.hashclient_retry_attempts = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_dead_retry      = 300 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_password        =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_sasl_enabled    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.memcache_username        =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.proxies                  = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.retry_attempts           = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.retry_delay              = 0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.socket_keepalive_count   = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.socket_keepalive_idle    = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.socket_keepalive_interval = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.tls_allowed_ciphers      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.tls_cafile               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.tls_certfile             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.tls_enabled              = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cache.tls_keyfile              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.auth_section            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.auth_type               = password {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.cafile                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.certfile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.collect_timing          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.cross_az_attach         = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.debug                   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.endpoint_template       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.http_retries            = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.insecure                = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.keyfile                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.os_region_name          = RegionOne {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.split_loggers           = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cinder.timeout                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.cpu_dedicated_set      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.cpu_shared_set         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.image_type_exclude_list = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.resource_provider_association_refresh = 300 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.shutdown_retry_interval = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] conductor.workers              = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] console.allowed_origins        = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] console.ssl_ciphers            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] console.ssl_minimum_version    = default {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] consoleauth.token_ttl          = 600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.cafile                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.certfile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.collect_timing          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.connect_retries         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.connect_retry_delay     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.endpoint_override       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.insecure                = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.keyfile                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.max_version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.min_version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.region_name             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.service_name            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.service_type            = accelerator {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.split_loggers           = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.status_code_retries     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.timeout                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] cyborg.version                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.backend               = sqlalchemy {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.connection            = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.connection_debug      = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.connection_parameters =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.connection_recycle_time = 3600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.connection_trace      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.db_inc_retry_interval = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.db_max_retries        = 20 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.db_max_retry_interval = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.db_retry_interval     = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.max_overflow          = 50 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.max_pool_size         = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.max_retries           = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.mysql_enable_ndb      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.mysql_wsrep_sync_wait = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.pool_timeout          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.retry_interval        = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.slave_connection      = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] database.sqlite_synchronous    = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.backend           = sqlalchemy {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.connection        = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.connection_debug  = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.connection_parameters =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.connection_recycle_time = 3600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.connection_trace  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.db_inc_retry_interval = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.db_max_retries    = 20 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.db_max_retry_interval = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.db_retry_interval = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.max_overflow      = 50 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.max_pool_size     = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.max_retries       = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.mysql_enable_ndb  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.pool_timeout      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.retry_interval    = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.slave_connection  = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] api_database.sqlite_synchronous = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] devices.enabled_mdev_types     = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ephemeral_storage_encryption.enabled = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.api_servers             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.cafile                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.certfile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.collect_timing          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.connect_retries         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.connect_retry_delay     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.debug                   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.default_trusted_certificate_ids = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.enable_certificate_validation = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.enable_rbd_download     = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.endpoint_override       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.insecure                = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.keyfile                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.max_version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.min_version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.num_retries             = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.rbd_ceph_conf           =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.rbd_connect_timeout     = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.rbd_pool                =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.rbd_user                =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.region_name             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.service_name            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.service_type            = image {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.split_loggers           = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.status_code_retries     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.timeout                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.verify_glance_signatures = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] glance.version                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] guestfs.debug                  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.config_drive_cdrom      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.config_drive_inject_password = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.enable_remotefx         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.instances_path_share    =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.limit_cpu_features      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.use_multipath_io        = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.vswitch_name            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] mks.enabled                    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] image_cache.manager_interval   = 2400 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] image_cache.precache_concurrency = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] image_cache.remove_unused_base_images = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] image_cache.subdirectory_name  = _base {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.api_max_retries         = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.api_retry_interval      = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.auth_section            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.auth_type               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.cafile                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.certfile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.collect_timing          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.connect_retries         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.connect_retry_delay     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.endpoint_override       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.insecure                = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.keyfile                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.max_version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.min_version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.partition_key           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.peer_list               = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.region_name             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.serial_console_state_timeout = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.service_name            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.service_type            = baremetal {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.split_loggers           = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.status_code_retries     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.timeout                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ironic.version                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] key_manager.fixed_key          = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.barbican_api_version  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.barbican_endpoint     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.barbican_endpoint_type = public {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.barbican_region_name  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.cafile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.certfile              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.collect_timing        = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.insecure              = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.keyfile               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.number_of_retries     = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.retry_delay           = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.send_service_user_token = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.split_loggers         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.timeout               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.verify_ssl            = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican.verify_ssl_path       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.auth_section = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.auth_type = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.cafile   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.certfile = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.collect_timing = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.insecure = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.keyfile  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.split_loggers = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] barbican_service_user.timeout  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.approle_role_id          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.approle_secret_id        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.cafile                   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.certfile                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.collect_timing           = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.insecure                 = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.keyfile                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.kv_mountpoint            = secret {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.kv_version               = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.namespace                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.root_token_id            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.split_loggers            = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.ssl_ca_crt_file          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.timeout                  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.use_ssl                  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.cafile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.certfile              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.collect_timing        = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.connect_retries       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.connect_retry_delay   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.endpoint_override     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.insecure              = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.keyfile               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.max_version           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.min_version           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.region_name           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.service_name          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.service_type          = identity {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.split_loggers         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.status_code_retries   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.timeout               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] keystone.version               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.connection_uri         =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_mode               = custom {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: WARNING oslo_config.cfg [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_power_governor_high = performance {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_power_management   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.device_detach_attempts = 8 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.device_detach_timeout  = 20 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.disk_cachemodes        = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.disk_prefix            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.enabled_perf_events    = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.file_backed_memory     = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.gid_maps               = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.hw_disk_discard        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.hw_machine_type        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_rbd_pool        = rbd {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_type            = default {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.images_volume_group    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.inject_key             = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.inject_partition       = -2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.inject_password        = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.iscsi_iface            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.iser_use_multipath     = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_downtime = 500 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_inbound_addr = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_scheme  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_timeout_action = abort {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_tunnelled = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: WARNING oslo_config.cfg [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 15:32:24 user nova-compute[71500]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 15:32:24 user nova-compute[71500]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 15:32:24 user nova-compute[71500]: and ``live_migration_inbound_addr`` respectively.
Apr 14 15:32:24 user nova-compute[71500]: ).  Its value may be silently ignored in the future.
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.live_migration_with_native_tls = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.max_queues             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.nfs_mount_options      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.num_pcie_ports         = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.pmem_namespaces        = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.quobyte_client_cfg     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rbd_secret_uuid        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rbd_user               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rescue_image_id        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rescue_kernel_id       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.rx_queue_size          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.smbfs_mount_options    =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.snapshot_compression   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.snapshot_image_format  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.sparse_logical_volumes = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.swtpm_enabled          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.swtpm_group            = tss {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.swtpm_user             = tss {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.sysinfo_serial         = unique {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.tx_queue_size          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.uid_maps               = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.use_virtio_for_bridges = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.virt_type              = kvm {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.volume_clear           = zero {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.volume_clear_size      = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.volume_use_multipath   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_cache_path   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.auth_section           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.auth_type              = password {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.cafile                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.certfile               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.collect_timing         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.connect_retries        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.connect_retry_delay    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.default_floating_pool  = public {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.endpoint_override      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.extension_sync_interval = 600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.http_retries           = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.insecure               = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.keyfile                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.max_version            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.min_version            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.ovs_bridge             = br-int {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.physnets               = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.region_name            = RegionOne {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.service_metadata_proxy = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.service_name           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.service_type           = network {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.split_loggers          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.status_code_retries    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.timeout                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] neutron.version                = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] notifications.bdms_in_notifications = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] notifications.default_level    = INFO {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] notifications.notification_format = unversioned {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] notifications.notify_on_state_change = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] pci.alias                      = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] pci.device_spec                = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] pci.report_in_placement        = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.auth_section         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.auth_type            = password {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.cafile               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.certfile             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.collect_timing       = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.connect_retries      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.connect_retry_delay  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.default_domain_id    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.default_domain_name  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.domain_id            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.domain_name          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.endpoint_override    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.insecure             = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.keyfile              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.max_version          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.min_version          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.password             = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.project_domain_id    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.project_domain_name  = Default {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.project_id           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.project_name         = service {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.region_name          = RegionOne {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.service_name         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.service_type         = placement {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.split_loggers        = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.status_code_retries  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.system_scope         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.timeout              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.trust_id             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.user_domain_id       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.user_domain_name     = Default {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.user_id              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.username             = placement {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] placement.version              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.cores                    = 20 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.count_usage_from_placement = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.injected_file_content_bytes = 10240 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.injected_file_path_length = 255 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.injected_files           = 5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.instances                = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.key_pairs                = 100 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.metadata_items           = 128 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.ram                      = 51200 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.recheck_quota            = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.server_group_members     = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] quota.server_groups            = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rdp.enabled                    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.image_metadata_prefilter = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.max_attempts         = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.max_placement_results = 1000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] scheduler.workers              = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.host_subset_size = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.isolated_hosts = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.isolated_images = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.pci_in_placement = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.track_instance_changes = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metrics.required               = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metrics.weight_multiplier      = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] metrics.weight_setting         = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] serial_console.enabled         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] serial_console.port_range      = 10000:20000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] serial_console.serialproxy_port = 6083 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.auth_section      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.auth_type         = password {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.cafile            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.certfile          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.collect_timing    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.insecure          = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.keyfile           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.send_service_user_token = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.split_loggers     = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] service_user.timeout           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.agent_enabled            = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.enabled                  = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.html5proxy_port          = 6082 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.image_compression        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.jpeg_compression         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.playback_compression     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.server_listen            = 127.0.0.1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.streaming_mode           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] spice.zlib_compression         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] upgrade_levels.baseapi         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] upgrade_levels.cert            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] upgrade_levels.compute         = auto {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] upgrade_levels.conductor       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] upgrade_levels.scheduler       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.cafile = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.certfile = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.insecure = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vendordata_dynamic_auth.timeout = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.api_retry_count         = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.ca_file                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.cache_prefix            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.cluster_name            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.connection_pool_size    = 10 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.console_delay_seconds   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.datastore_regex         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.host_ip                 = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.host_password           = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.host_port               = 443 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.host_username           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.insecure                = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.integration_bridge      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.maximum_objects         = 100 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.pbm_default_policy      = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.pbm_enabled             = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.pbm_wsdl_location       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.serial_port_proxy_uri   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.serial_port_service_uri = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.task_poll_interval      = 0.5 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.use_linked_clone        = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.vnc_keymap              = en-us {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.vnc_port                = 5900 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vmware.vnc_port_total          = 10000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.auth_schemes               = ['none'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.enabled                    = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.novncproxy_port            = 6080 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.vencrypt_ca_certs          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.vencrypt_client_cert       = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vnc.vencrypt_client_key        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.disable_rootwrap   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.enable_numa_live_migration = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.libvirt_disable_apic = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.client_socket_timeout     = 900 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.default_pool_size         = 1000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.keep_alive                = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.max_header_line           = 16384 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.ssl_ca_file               = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.ssl_cert_file             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.ssl_key_file              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.tcp_keepidle              = 600 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] zvm.ca_file                    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] zvm.cloud_connector_url        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] zvm.reachable_timeout          = 300 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.enforce_new_defaults = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.enforce_scope      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.policy_default_rule = default {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.connection_string     = messaging:// {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.enabled               = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.es_doc_type           = notification {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.es_scroll_size        = 10000 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.es_scroll_time        = 2m {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.filter_error_trace    = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.sentinel_service_name = mymaster {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.socket_timeout        = 0.1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] profiler.trace_sqlalchemy      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] remote_debug.host              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] remote_debug.port              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_notifications.retry = -1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.auth_section        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.auth_type           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.cafile              = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.certfile            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.collect_timing      = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.connect_retries     = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.connect_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.endpoint_id         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.endpoint_override   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.insecure            = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.keyfile             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.max_version         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.min_version         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.region_name         = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.service_name        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.service_type        = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.split_loggers       = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.status_code_retries = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.status_code_retry_delay = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.timeout             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.valid_interfaces    = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_limit.version             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_reports.file_event_handler = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] oslo_reports.log_dir           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_ovs_privileged.group  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] vif_plug_ovs_privileged.user   = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_ovs.isolate_vif         = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] os_brick.lock_path             = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] privsep_osbrick.capabilities   = [21] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] privsep_osbrick.group          = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] privsep_osbrick.helper_command = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] privsep_osbrick.user           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] nova_sys_admin.group           = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] nova_sys_admin.helper_command  = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] nova_sys_admin.user            = None {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG oslo_service.service [None req-1b98511a-af70-4308-86ab-783b5f098028 None None] ******************************************************************************** {{(pid=71500) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 15:32:24 user nova-compute[71500]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Starting native event thread {{(pid=71500) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Starting green dispatch thread {{(pid=71500) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Starting connection event dispatch thread {{(pid=71500) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Connecting to libvirt: qemu:///system {{(pid=71500) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fadfe0b6680> {{(pid=71500) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fadfe0b6680> {{(pid=71500) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 15:32:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Connection event '1' reason 'None'
Apr 14 15:32:24 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 15:32:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.mount [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Initialising _HostMountState generation 0 {{(pid=71500) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 15:32:31 user nova-compute[71500]: INFO nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host capabilities <capabilities>
Apr 14 15:32:31 user nova-compute[71500]:   <host>
Apr 14 15:32:31 user nova-compute[71500]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 15:32:31 user nova-compute[71500]:     <cpu>
Apr 14 15:32:31 user nova-compute[71500]:       <arch>x86_64</arch>
Apr 14 15:32:31 user nova-compute[71500]:       <model>IvyBridge-IBRS</model>
Apr 14 15:32:31 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:31 user nova-compute[71500]:       <microcode version='1070'/>
Apr 14 15:32:31 user nova-compute[71500]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 15:32:31 user nova-compute[71500]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='ss'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='vmx'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='pcid'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='osxsave'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='hypervisor'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='arat'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='tsc_adjust'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='md-clear'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='stibp'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='arch-capabilities'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='ssbd'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='invtsc'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='rsba'/>
Apr 14 15:32:31 user nova-compute[71500]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 15:32:31 user nova-compute[71500]:       <pages unit='KiB' size='4'/>
Apr 14 15:32:31 user nova-compute[71500]:       <pages unit='KiB' size='2048'/>
Apr 14 15:32:31 user nova-compute[71500]:     </cpu>
Apr 14 15:32:31 user nova-compute[71500]:     <power_management>
Apr 14 15:32:31 user nova-compute[71500]:       <suspend_mem/>
Apr 14 15:32:31 user nova-compute[71500]:       <suspend_disk/>
Apr 14 15:32:31 user nova-compute[71500]:       <suspend_hybrid/>
Apr 14 15:32:31 user nova-compute[71500]:     </power_management>
Apr 14 15:32:31 user nova-compute[71500]:     <iommu support='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     <migration_features>
Apr 14 15:32:31 user nova-compute[71500]:       <live/>
Apr 14 15:32:31 user nova-compute[71500]:       <uri_transports>
Apr 14 15:32:31 user nova-compute[71500]:         <uri_transport>tcp</uri_transport>
Apr 14 15:32:31 user nova-compute[71500]:         <uri_transport>rdma</uri_transport>
Apr 14 15:32:31 user nova-compute[71500]:       </uri_transports>
Apr 14 15:32:31 user nova-compute[71500]:     </migration_features>
Apr 14 15:32:31 user nova-compute[71500]:     <topology>
Apr 14 15:32:31 user nova-compute[71500]:       <cells num='2'>
Apr 14 15:32:31 user nova-compute[71500]:         <cell id='0'>
Apr 14 15:32:31 user nova-compute[71500]:           <memory unit='KiB'>8152920</memory>
Apr 14 15:32:31 user nova-compute[71500]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 14 15:32:31 user nova-compute[71500]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 15:32:31 user nova-compute[71500]:           <distances>
Apr 14 15:32:31 user nova-compute[71500]:             <sibling id='0' value='10'/>
Apr 14 15:32:31 user nova-compute[71500]:             <sibling id='1' value='20'/>
Apr 14 15:32:31 user nova-compute[71500]:           </distances>
Apr 14 15:32:31 user nova-compute[71500]:           <cpus num='6'>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 15:32:31 user nova-compute[71500]:           </cpus>
Apr 14 15:32:31 user nova-compute[71500]:         </cell>
Apr 14 15:32:31 user nova-compute[71500]:         <cell id='1'>
Apr 14 15:32:31 user nova-compute[71500]:           <memory unit='KiB'>8255068</memory>
Apr 14 15:32:31 user nova-compute[71500]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 14 15:32:31 user nova-compute[71500]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 15:32:31 user nova-compute[71500]:           <distances>
Apr 14 15:32:31 user nova-compute[71500]:             <sibling id='0' value='20'/>
Apr 14 15:32:31 user nova-compute[71500]:             <sibling id='1' value='10'/>
Apr 14 15:32:31 user nova-compute[71500]:           </distances>
Apr 14 15:32:31 user nova-compute[71500]:           <cpus num='6'>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 15:32:31 user nova-compute[71500]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 15:32:31 user nova-compute[71500]:           </cpus>
Apr 14 15:32:31 user nova-compute[71500]:         </cell>
Apr 14 15:32:31 user nova-compute[71500]:       </cells>
Apr 14 15:32:31 user nova-compute[71500]:     </topology>
Apr 14 15:32:31 user nova-compute[71500]:     <cache>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 15:32:31 user nova-compute[71500]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 15:32:31 user nova-compute[71500]:     </cache>
Apr 14 15:32:31 user nova-compute[71500]:     <secmodel>
Apr 14 15:32:31 user nova-compute[71500]:       <model>apparmor</model>
Apr 14 15:32:31 user nova-compute[71500]:       <doi>0</doi>
Apr 14 15:32:31 user nova-compute[71500]:     </secmodel>
Apr 14 15:32:31 user nova-compute[71500]:     <secmodel>
Apr 14 15:32:31 user nova-compute[71500]:       <model>dac</model>
Apr 14 15:32:31 user nova-compute[71500]:       <doi>0</doi>
Apr 14 15:32:31 user nova-compute[71500]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 15:32:31 user nova-compute[71500]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 15:32:31 user nova-compute[71500]:     </secmodel>
Apr 14 15:32:31 user nova-compute[71500]:   </host>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='alpha'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>clipper</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='armv6l'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>spitz</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>nuri</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>kzm</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sx1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>z2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>tosa</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>n810</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>n800</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>terrier</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>midway</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>microbit</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>verdex</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>highbank</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>akita</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>connex</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>collie</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='armv7l'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>spitz</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>nuri</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>kzm</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sx1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>z2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>tosa</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>n810</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>n800</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>terrier</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>midway</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>microbit</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>verdex</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>highbank</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>akita</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>connex</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>collie</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='aarch64'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>spitz</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>nuri</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>kzm</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sx1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>z2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>tosa</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>n810</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>n800</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>terrier</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>midway</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>microbit</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>verdex</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='4'>highbank</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>akita</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>connex</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>collie</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <acpi default='on' toggle='yes'/>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='cris'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='i686'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>isapc</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>microvm</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='kvm'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <pae/>
Apr 14 15:32:31 user nova-compute[71500]:       <nonpae/>
Apr 14 15:32:31 user nova-compute[71500]:       <acpi default='on' toggle='yes'/>
Apr 14 15:32:31 user nova-compute[71500]:       <apic default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='m68k'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>an5206</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>q800</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='microblaze'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='microblazeel'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='mips'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='16'>malta</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='mipsel'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='16'>malta</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 15:32:31 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:31 user nova-compute[71500]:     </arch>
Apr 14 15:32:31 user nova-compute[71500]:     <features>
Apr 14 15:32:31 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:31 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:31 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:31 user nova-compute[71500]:     </features>
Apr 14 15:32:31 user nova-compute[71500]:   </guest>
Apr 14 15:32:31 user nova-compute[71500]:   <guest>
Apr 14 15:32:31 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:31 user nova-compute[71500]:     <arch name='mips64'>
Apr 14 15:32:31 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:31 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='16'>malta</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>pica61</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>magnum</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='mips64el'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='16'>malta</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>pica61</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>magnum</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='16'>boston</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='ppc'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>mac99</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>40p</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>taihu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='ppc64'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>taihu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>40p</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>mac99</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='ppc64le'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>taihu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>40p</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>mac99</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='riscv32'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='8'>spike</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='8'>virt</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='riscv64'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='8'>spike</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='8'>virt</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='s390x'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='sh4'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>shix</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>r2d</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='sh4eb'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>shix</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>r2d</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='sparc'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>LX</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='sparc64'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>niagara</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='x86_64'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>64</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='1'>isapc</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>microvm</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='kvm'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <acpi default='on' toggle='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:       <apic default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='xtensa'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='4'>sim</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>kc705</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ml605</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>virt</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx200</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx60</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]:   <guest>
Apr 14 15:32:32 user nova-compute[71500]:     <os_type>hvm</os_type>
Apr 14 15:32:32 user nova-compute[71500]:     <arch name='xtensaeb'>
Apr 14 15:32:32 user nova-compute[71500]:       <wordsize>32</wordsize>
Apr 14 15:32:32 user nova-compute[71500]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='4'>sim</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>kc705</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ml605</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>virt</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx200</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>lx60</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 15:32:32 user nova-compute[71500]:       <domain type='qemu'/>
Apr 14 15:32:32 user nova-compute[71500]:     </arch>
Apr 14 15:32:32 user nova-compute[71500]:     <features>
Apr 14 15:32:32 user nova-compute[71500]:       <cpuselection/>
Apr 14 15:32:32 user nova-compute[71500]:       <deviceboot/>
Apr 14 15:32:32 user nova-compute[71500]:       <disksnapshot default='on' toggle='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     </features>
Apr 14 15:32:32 user nova-compute[71500]:   </guest>
Apr 14 15:32:32 user nova-compute[71500]: </capabilities>
Apr 14 15:32:32 user nova-compute[71500]: 
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-q35-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>i686</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='288'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'/>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='lm'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-i440fx-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>i686</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='255'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'/>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='lm'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ide</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-q35-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>i686</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='288'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'/>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='lm'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-i440fx-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>i686</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='255'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'/>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='lm'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ide</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-q35-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>x86_64</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='288'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>efi</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='invtsc'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='rsba'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-i440fx-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>x86_64</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='255'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>efi</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='invtsc'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='rsba'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ide</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-q35-6.2</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>x86_64</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='288'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>efi</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='invtsc'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='rsba'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 15:32:32 user nova-compute[71500]: <domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 15:32:32 user nova-compute[71500]:   <domain>kvm</domain>
Apr 14 15:32:32 user nova-compute[71500]:   <machine>pc-i440fx-jammy</machine>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>x86_64</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <vcpu max='255'/>
Apr 14 15:32:32 user nova-compute[71500]:   <iothreads supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:   <os supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='firmware'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>efi</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:     <loader supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>rom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pflash</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='readonly'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>yes</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='secure'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>no</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </loader>
Apr 14 15:32:32 user nova-compute[71500]:   </os>
Apr 14 15:32:32 user nova-compute[71500]:   <cpu>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-passthrough' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='hostPassthroughMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='maximum' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='maximumMigratable'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>on</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>off</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='host-model' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ss'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='vmx'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pcid'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='hypervisor'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arat'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='umip'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='md-clear'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='invtsc'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibpb'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='ibrs'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-stibp'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='rsba'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='erms'/>
Apr 14 15:32:32 user nova-compute[71500]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:     <mode name='custom' supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>qemu64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>qemu32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>phenom</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>pentium</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>n270</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm64</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>kvm32</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>coreduo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>core2duo</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>athlon</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Westmere</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Snowridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Skylake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>SandyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Penryn</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G5</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G4</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G3</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Opteron_G2</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Opteron_G1</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>IvyBridge</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Icelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Haswell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Rome</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-Milan</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>EPYC</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Dhyana</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cooperlake</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>Conroe</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='no'>Broadwell</model>
Apr 14 15:32:32 user nova-compute[71500]:       <model usable='yes'>486</model>
Apr 14 15:32:32 user nova-compute[71500]:     </mode>
Apr 14 15:32:32 user nova-compute[71500]:   </cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <memoryBacking supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:     <enum name='sourceType'>
Apr 14 15:32:32 user nova-compute[71500]:       <value>file</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>anonymous</value>
Apr 14 15:32:32 user nova-compute[71500]:       <value>memfd</value>
Apr 14 15:32:32 user nova-compute[71500]:     </enum>
Apr 14 15:32:32 user nova-compute[71500]:   </memoryBacking>
Apr 14 15:32:32 user nova-compute[71500]:   <devices>
Apr 14 15:32:32 user nova-compute[71500]:     <disk supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='diskDevice'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>disk</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cdrom</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>floppy</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>lun</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='bus'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ide</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>fdc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sata</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </disk>
Apr 14 15:32:32 user nova-compute[71500]:     <graphics supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='type'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>sdl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vnc</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>spice</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egl-headless</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </graphics>
Apr 14 15:32:32 user nova-compute[71500]:     <video supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='modelType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>cirrus</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>vmvga</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>qxl</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>none</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>bochs</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>ramfb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </video>
Apr 14 15:32:32 user nova-compute[71500]:     <hostdev supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='mode'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>subsystem</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='startupPolicy'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>default</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>mandatory</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>requisite</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>optional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='subsysType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>usb</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>pci</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>scsi</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='capsType'/>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='pciBackend'/>
Apr 14 15:32:32 user nova-compute[71500]:     </hostdev>
Apr 14 15:32:32 user nova-compute[71500]:     <rng supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtio-non-transitional</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>random</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>egd</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>builtin</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </rng>
Apr 14 15:32:32 user nova-compute[71500]:     <filesystem supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='driverType'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>path</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>handle</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>virtiofs</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </filesystem>
Apr 14 15:32:32 user nova-compute[71500]:     <tpm supported='yes'>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='model'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-tis</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>tpm-crb</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:       <enum name='backendModel'>
Apr 14 15:32:32 user nova-compute[71500]:         <value>passthrough</value>
Apr 14 15:32:32 user nova-compute[71500]:         <value>emulator</value>
Apr 14 15:32:32 user nova-compute[71500]:       </enum>
Apr 14 15:32:32 user nova-compute[71500]:     </tpm>
Apr 14 15:32:32 user nova-compute[71500]:   </devices>
Apr 14 15:32:32 user nova-compute[71500]:   <features>
Apr 14 15:32:32 user nova-compute[71500]:     <gic supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:     <vmcoreinfo supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <genid supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backingStoreInput supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <backup supported='yes'/>
Apr 14 15:32:32 user nova-compute[71500]:     <sev supported='no'/>
Apr 14 15:32:32 user nova-compute[71500]:   </features>
Apr 14 15:32:32 user nova-compute[71500]: </domainCapabilities>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71500) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71500) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Checking secure boot support for host arch (x86_64) {{(pid=71500) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Secure Boot support detected
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] cpu compare xml: <cpu match="exact">
Apr 14 15:32:32 user nova-compute[71500]:   <model>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]: </cpu>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.virt.node [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Generated node identity 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.virt.node [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Wrote node identity 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 to /opt/stack/data/nova/compute_id
Apr 14 15:32:32 user nova-compute[71500]: WARNING nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Compute nodes ['7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 15:32:32 user nova-compute[71500]: WARNING nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 15:32:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:32:32 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:32:32 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Hypervisor/Node resource view: name=user free_ram=10743MB free_disk=27.19121551513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:32:32 user nova-compute[71500]: WARNING nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] No compute node record for user:7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 could not be found.
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Compute node record created for user:user with uuid: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [req-5bfca38c-189c-4935-ba45-286055d2bf13] Created resource provider record via placement API for resource provider with UUID 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 and name user.
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71500) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 15:32:32 user nova-compute[71500]: INFO nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] kernel doesn't support AMD SEV
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Libvirt baseline CPU <cpu>
Apr 14 15:32:32 user nova-compute[71500]:   <arch>x86_64</arch>
Apr 14 15:32:32 user nova-compute[71500]:   <model>Nehalem</model>
Apr 14 15:32:32 user nova-compute[71500]:   <vendor>Intel</vendor>
Apr 14 15:32:32 user nova-compute[71500]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 15:32:32 user nova-compute[71500]: </cpu>
Apr 14 15:32:32 user nova-compute[71500]:  {{(pid=71500) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Updated inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Updating resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 generation from 0 to 1 during operation: update_inventory {{(pid=71500) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 15:32:32 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:32:33 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Updating resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 generation from 1 to 2 during operation: update_traits {{(pid=71500) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 15:32:33 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:32:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:32:33 user nova-compute[71500]: DEBUG nova.service [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Creating RPC server for service compute {{(pid=71500) start /opt/stack/nova/nova/service.py:182}}
Apr 14 15:32:33 user nova-compute[71500]: DEBUG nova.service [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Join ServiceGroup membership for this service compute {{(pid=71500) start /opt/stack/nova/nova/service.py:199}}
Apr 14 15:32:33 user nova-compute[71500]: DEBUG nova.servicegroup.drivers.db [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71500) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 15:33:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:33:24 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:33:24 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=10132MB free_disk=26.936683654785156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:33:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:34:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:34:26 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:34:26 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=10125MB free_disk=26.98053741455078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:34:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:35:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:35:26 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:35:26 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=10162MB free_disk=26.75876235961914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:35:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:35:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:35:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:36:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:36:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:36:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:36:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:36:27 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:27 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=9431MB free_disk=26.789684295654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:36:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:28 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:28 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:28 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:36:32 user nova-compute[71500]: INFO nova.compute.claims [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Claim successful on node user
Apr 14 15:36:32 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:36:33 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:36:33 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Creating image(s)
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "/opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "/opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "/opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.025s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.policy [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '556b4bd256ee41398d5fd89ef2191550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef8097227d514468b100a6a637bb6287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.virt.images [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] e3a0daa8-78ae-44af-8756-1fad21c352f3 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:36:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.part /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.part /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.converted" returned: 0 in 0.198s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "0339b7d6-294b-4669-9782-51de5748226a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.055s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:34 user nova-compute[71500]: INFO oslo.privsep.daemon [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcxy2fop2/privsep.sock']
Apr 14 15:36:34 user sudo[80670]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcxy2fop2/privsep.sock
Apr 14 15:36:34 user sudo[80670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:36:34 user nova-compute[71500]: INFO nova.compute.claims [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Claim successful on node user
Apr 14 15:36:34 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:36:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:36:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:36:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Creating image(s)
Apr 14 15:36:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "/opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "/opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "/opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:35 user nova-compute[71500]: DEBUG nova.policy [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:36:36 user sudo[80670]: pam_unix(sudo:session): session closed for user root
Apr 14 15:36:36 user nova-compute[71500]: INFO oslo.privsep.daemon [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Spawned new privsep daemon via rootwrap
Apr 14 15:36:36 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 15:36:36 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 15:36:36 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 15:36:36 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80681
Apr 14 15:36:36 user nova-compute[71500]: WARNING oslo_privsep.priv_context [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] privsep daemon already running
Apr 14 15:36:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.195s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.211s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:36:37 user nova-compute[71500]: INFO nova.compute.claims [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Claim successful on node user
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk 1073741824" returned: 0 in 0.050s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.175s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.162s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.167s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk 1073741824" returned: 0 in 0.050s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Cannot resize image /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lazy-loading 'migration_context' on Instance uuid c66b5102-c56e-4209-afb2-c2594b271af6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Ensure instance console log exists: /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:36:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Successfully created port: 4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Cannot resize image /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lazy-loading 'migration_context' on Instance uuid 0339b7d6-294b-4669-9782-51de5748226a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Ensure instance console log exists: /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:36:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Creating image(s)
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG nova.policy [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk 1073741824" returned: 0 in 0.049s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Cannot resize image /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'migration_context' on Instance uuid d8e21d6b-fc8f-4373-a54f-452ab5fa169c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:39 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Successfully created port: 29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:36:40 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Successfully created port: e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Successfully updated port: 4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquired lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-changed-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Refreshing instance network info cache due to event network-changed-4b57e07f-f5a9-4524-9f4a-f97133808b99. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:36:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Acquiring lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updating instance_info_cache with network_info: [{"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Releasing lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Instance network_info: |[{"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Acquired lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.network.neutron [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Refreshing network info cache for port 4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Start _get_guest_xml network_info=[{"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:36:42 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:42 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-725322254',display_name='tempest-DeleteServersTestJSON-server-725322254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-725322254',id=1,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef8097227d514468b100a6a637bb6287',ramdisk_id='',reservation_id='r-mzaglqaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-182432264',owner_user_name='tempest-DeleteServersTestJSON-182432264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:33Z,user_data=None,user_id='556b4bd256ee41398d5fd89ef2191550',uuid=c66b5102-c56e-4209-afb2-c2594b271af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Converting VIF {"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lazy-loading 'pci_devices' on Instance uuid c66b5102-c56e-4209-afb2-c2594b271af6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:36:42 user nova-compute[71500]:   <uuid>c66b5102-c56e-4209-afb2-c2594b271af6</uuid>
Apr 14 15:36:42 user nova-compute[71500]:   <name>instance-00000001</name>
Apr 14 15:36:42 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:36:42 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:36:42 user nova-compute[71500]:   <metadata>
Apr 14 15:36:42 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:36:42 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:36:42 user nova-compute[71500]:       <nova:name>tempest-DeleteServersTestJSON-server-725322254</nova:name>
Apr 14 15:36:42 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:36:42</nova:creationTime>
Apr 14 15:36:42 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:36:42 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:36:42 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:36:42 user nova-compute[71500]:       <nova:owner>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:user uuid="556b4bd256ee41398d5fd89ef2191550">tempest-DeleteServersTestJSON-182432264-project-member</nova:user>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:project uuid="ef8097227d514468b100a6a637bb6287">tempest-DeleteServersTestJSON-182432264</nova:project>
Apr 14 15:36:42 user nova-compute[71500]:       </nova:owner>
Apr 14 15:36:42 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:36:42 user nova-compute[71500]:       <nova:ports>
Apr 14 15:36:42 user nova-compute[71500]:         <nova:port uuid="4b57e07f-f5a9-4524-9f4a-f97133808b99">
Apr 14 15:36:42 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:36:42 user nova-compute[71500]:         </nova:port>
Apr 14 15:36:42 user nova-compute[71500]:       </nova:ports>
Apr 14 15:36:42 user nova-compute[71500]:     </nova:instance>
Apr 14 15:36:42 user nova-compute[71500]:   </metadata>
Apr 14 15:36:42 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:36:42 user nova-compute[71500]:     <system>
Apr 14 15:36:42 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:36:42 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:36:42 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:36:42 user nova-compute[71500]:       <entry name="serial">c66b5102-c56e-4209-afb2-c2594b271af6</entry>
Apr 14 15:36:42 user nova-compute[71500]:       <entry name="uuid">c66b5102-c56e-4209-afb2-c2594b271af6</entry>
Apr 14 15:36:42 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:36:42 user nova-compute[71500]:     </system>
Apr 14 15:36:42 user nova-compute[71500]:   </sysinfo>
Apr 14 15:36:42 user nova-compute[71500]:   <os>
Apr 14 15:36:42 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:36:42 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:36:42 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:36:42 user nova-compute[71500]:   </os>
Apr 14 15:36:42 user nova-compute[71500]:   <features>
Apr 14 15:36:42 user nova-compute[71500]:     <acpi/>
Apr 14 15:36:42 user nova-compute[71500]:     <apic/>
Apr 14 15:36:42 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:36:42 user nova-compute[71500]:   </features>
Apr 14 15:36:42 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:36:42 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:36:42 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:36:42 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:36:42 user nova-compute[71500]:   </clock>
Apr 14 15:36:42 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:36:42 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:36:42 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:36:42 user nova-compute[71500]:   </cpu>
Apr 14 15:36:42 user nova-compute[71500]:   <devices>
Apr 14 15:36:42 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:36:42 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:36:42 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk"/>
Apr 14 15:36:42 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:36:42 user nova-compute[71500]:     </disk>
Apr 14 15:36:42 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:36:42 user nova-compute[71500]:       <mac address="fa:16:3e:dc:23:60"/>
Apr 14 15:36:42 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:42 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:36:42 user nova-compute[71500]:       <target dev="tap4b57e07f-f5"/>
Apr 14 15:36:42 user nova-compute[71500]:     </interface>
Apr 14 15:36:42 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:36:42 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/console.log" append="off"/>
Apr 14 15:36:42 user nova-compute[71500]:     </serial>
Apr 14 15:36:42 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:36:42 user nova-compute[71500]:     <video>
Apr 14 15:36:42 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:42 user nova-compute[71500]:     </video>
Apr 14 15:36:42 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:36:42 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:36:42 user nova-compute[71500]:     </rng>
Apr 14 15:36:42 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:36:42 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:36:42 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:36:42 user nova-compute[71500]:     </memballoon>
Apr 14 15:36:42 user nova-compute[71500]:   </devices>
Apr 14 15:36:42 user nova-compute[71500]: </domain>
Apr 14 15:36:42 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-725322254',display_name='tempest-DeleteServersTestJSON-server-725322254',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-725322254',id=1,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef8097227d514468b100a6a637bb6287',ramdisk_id='',reservation_id='r-mzaglqaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-182432264',owner_user_name='tempest-DeleteServersTestJSON-182432264-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:33Z,user_data=None,user_id='556b4bd256ee41398d5fd89ef2191550',uuid=c66b5102-c56e-4209-afb2-c2594b271af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Converting VIF {"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG os_vif [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Created schema index Interface.name {{(pid=71500) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Created schema index Port.name {{(pid=71500) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Created schema index Bridge.name {{(pid=71500) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [POLLOUT] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:36:42 user nova-compute[71500]: INFO oslo.privsep.daemon [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpij5f3ctv/privsep.sock']
Apr 14 15:36:42 user sudo[80738]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpij5f3ctv/privsep.sock
Apr 14 15:36:42 user sudo[80738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 15:36:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Successfully updated port: 29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquired lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-changed-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Refreshing instance network info cache due to event network-changed-29225f48-b889-4b7d-b5be-6c47f5c4b076. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Acquiring lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:36:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Successfully updated port: e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.compute.manager [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-changed-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.compute.manager [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Refreshing instance network info cache due to event network-changed-e04c622c-58ef-477e-8d37-eb052355492e. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Acquiring lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:44 user sudo[80738]: pam_unix(sudo:session): session closed for user root
Apr 14 15:36:44 user nova-compute[71500]: INFO oslo.privsep.daemon [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Spawned new privsep daemon via rootwrap
Apr 14 15:36:44 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 15:36:44 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 15:36:44 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 15:36:44 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80744
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updated VIF entry in instance network info cache for port 4b57e07f-f5a9-4524-9f4a-f97133808b99. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updating instance_info_cache with network_info: [{"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f80c59f6-b21b-408f-a24a-768071f0fe64 req-4212985a-a9f2-4507-b980-97b6d45f9957 service nova] Releasing lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b57e07f-f5, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b57e07f-f5, col_values=(('external_ids', {'iface-id': '4b57e07f-f5a9-4524-9f4a-f97133808b99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:23:60', 'vm-uuid': 'c66b5102-c56e-4209-afb2-c2594b271af6'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:44 user nova-compute[71500]: INFO os_vif [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5')
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:36:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] No VIF found with MAC fa:16:3e:dc:23:60, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updating instance_info_cache with network_info: [{"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Releasing lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Instance network_info: |[{"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Acquired lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.neutron [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Refreshing network info cache for port 29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Start _get_guest_xml network_info=[{"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:36:45 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:45 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1469009849',display_name='tempest-ServersNegativeTestJSON-server-1469009849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1469009849',id=2,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a8e73ef2ad94e84876def53ddf43da4',ramdisk_id='',reservation_id='r-l1ma4hs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-443911091',owner_user_name='tempest-ServersNegativeTestJSON-443911091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:35Z,user_data=None,user_id='af824b840c604223afd90bce17fe1ceb',uuid=0339b7d6-294b-4669-9782-51de5748226a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converting VIF {"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lazy-loading 'pci_devices' on Instance uuid 0339b7d6-294b-4669-9782-51de5748226a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:36:45 user nova-compute[71500]:   <uuid>0339b7d6-294b-4669-9782-51de5748226a</uuid>
Apr 14 15:36:45 user nova-compute[71500]:   <name>instance-00000002</name>
Apr 14 15:36:45 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:36:45 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:36:45 user nova-compute[71500]:   <metadata>
Apr 14 15:36:45 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:36:45 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:name>tempest-ServersNegativeTestJSON-server-1469009849</nova:name>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:36:45</nova:creationTime>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:36:45 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:36:45 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:owner>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:user uuid="af824b840c604223afd90bce17fe1ceb">tempest-ServersNegativeTestJSON-443911091-project-member</nova:user>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:project uuid="3a8e73ef2ad94e84876def53ddf43da4">tempest-ServersNegativeTestJSON-443911091</nova:project>
Apr 14 15:36:45 user nova-compute[71500]:       </nova:owner>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:ports>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:port uuid="29225f48-b889-4b7d-b5be-6c47f5c4b076">
Apr 14 15:36:45 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 15:36:45 user nova-compute[71500]:         </nova:port>
Apr 14 15:36:45 user nova-compute[71500]:       </nova:ports>
Apr 14 15:36:45 user nova-compute[71500]:     </nova:instance>
Apr 14 15:36:45 user nova-compute[71500]:   </metadata>
Apr 14 15:36:45 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:36:45 user nova-compute[71500]:     <system>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="serial">0339b7d6-294b-4669-9782-51de5748226a</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="uuid">0339b7d6-294b-4669-9782-51de5748226a</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:36:45 user nova-compute[71500]:     </system>
Apr 14 15:36:45 user nova-compute[71500]:   </sysinfo>
Apr 14 15:36:45 user nova-compute[71500]:   <os>
Apr 14 15:36:45 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:36:45 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:36:45 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:36:45 user nova-compute[71500]:   </os>
Apr 14 15:36:45 user nova-compute[71500]:   <features>
Apr 14 15:36:45 user nova-compute[71500]:     <acpi/>
Apr 14 15:36:45 user nova-compute[71500]:     <apic/>
Apr 14 15:36:45 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:36:45 user nova-compute[71500]:   </features>
Apr 14 15:36:45 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:36:45 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:36:45 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:36:45 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:36:45 user nova-compute[71500]:   </clock>
Apr 14 15:36:45 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:36:45 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:36:45 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:36:45 user nova-compute[71500]:   </cpu>
Apr 14 15:36:45 user nova-compute[71500]:   <devices>
Apr 14 15:36:45 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:36:45 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:36:45 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk"/>
Apr 14 15:36:45 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:36:45 user nova-compute[71500]:     </disk>
Apr 14 15:36:45 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:36:45 user nova-compute[71500]:       <mac address="fa:16:3e:56:db:15"/>
Apr 14 15:36:45 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:45 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:36:45 user nova-compute[71500]:       <target dev="tap29225f48-b8"/>
Apr 14 15:36:45 user nova-compute[71500]:     </interface>
Apr 14 15:36:45 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:36:45 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/console.log" append="off"/>
Apr 14 15:36:45 user nova-compute[71500]:     </serial>
Apr 14 15:36:45 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:36:45 user nova-compute[71500]:     <video>
Apr 14 15:36:45 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:45 user nova-compute[71500]:     </video>
Apr 14 15:36:45 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:36:45 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:36:45 user nova-compute[71500]:     </rng>
Apr 14 15:36:45 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:36:45 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:36:45 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:36:45 user nova-compute[71500]:     </memballoon>
Apr 14 15:36:45 user nova-compute[71500]:   </devices>
Apr 14 15:36:45 user nova-compute[71500]: </domain>
Apr 14 15:36:45 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1469009849',display_name='tempest-ServersNegativeTestJSON-server-1469009849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1469009849',id=2,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a8e73ef2ad94e84876def53ddf43da4',ramdisk_id='',reservation_id='r-l1ma4hs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-443911091',owner_user_name='tempest-ServersNegativeTestJSON-443911091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:35Z,user_data=None,user_id='af824b840c604223afd90bce17fe1ceb',uuid=0339b7d6-294b-4669-9782-51de5748226a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converting VIF {"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG os_vif [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29225f48-b8, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29225f48-b8, col_values=(('external_ids', {'iface-id': '29225f48-b889-4b7d-b5be-6c47f5c4b076', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:db:15', 'vm-uuid': '0339b7d6-294b-4669-9782-51de5748226a'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:45 user nova-compute[71500]: INFO os_vif [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8')
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:36:45 user nova-compute[71500]: INFO nova.compute.claims [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Claim successful on node user
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] No VIF found with MAC fa:16:3e:56:db:15, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.265s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:36:45 user nova-compute[71500]: INFO nova.compute.claims [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Claim successful on node user
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updating instance_info_cache with network_info: [{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Instance network_info: |[{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Acquired lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.neutron [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Refreshing network info cache for port e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Start _get_guest_xml network_info=[{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:36:45 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:45 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1391704245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1391704245',id=3,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-yo4f6s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:38Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=d8e21d6b-fc8f-4373-a54f-452ab5fa169c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e21d6b-fc8f-4373-a54f-452ab5fa169c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:36:45 user nova-compute[71500]:   <uuid>d8e21d6b-fc8f-4373-a54f-452ab5fa169c</uuid>
Apr 14 15:36:45 user nova-compute[71500]:   <name>instance-00000003</name>
Apr 14 15:36:45 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:36:45 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:36:45 user nova-compute[71500]:   <metadata>
Apr 14 15:36:45 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:36:45 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1391704245</nova:name>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:36:45</nova:creationTime>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:36:45 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:36:45 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:owner>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:user uuid="efb645d110464e7e85d7c955ee9f3466">tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member</nova:user>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:project uuid="584a53650c014f87b9622f2011996200">tempest-ServerBootFromVolumeStableRescueTest-756745587</nova:project>
Apr 14 15:36:45 user nova-compute[71500]:       </nova:owner>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:36:45 user nova-compute[71500]:       <nova:ports>
Apr 14 15:36:45 user nova-compute[71500]:         <nova:port uuid="e04c622c-58ef-477e-8d37-eb052355492e">
Apr 14 15:36:45 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 15:36:45 user nova-compute[71500]:         </nova:port>
Apr 14 15:36:45 user nova-compute[71500]:       </nova:ports>
Apr 14 15:36:45 user nova-compute[71500]:     </nova:instance>
Apr 14 15:36:45 user nova-compute[71500]:   </metadata>
Apr 14 15:36:45 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:36:45 user nova-compute[71500]:     <system>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="serial">d8e21d6b-fc8f-4373-a54f-452ab5fa169c</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="uuid">d8e21d6b-fc8f-4373-a54f-452ab5fa169c</entry>
Apr 14 15:36:45 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:36:45 user nova-compute[71500]:     </system>
Apr 14 15:36:45 user nova-compute[71500]:   </sysinfo>
Apr 14 15:36:45 user nova-compute[71500]:   <os>
Apr 14 15:36:45 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:36:45 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:36:45 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:36:45 user nova-compute[71500]:   </os>
Apr 14 15:36:45 user nova-compute[71500]:   <features>
Apr 14 15:36:45 user nova-compute[71500]:     <acpi/>
Apr 14 15:36:45 user nova-compute[71500]:     <apic/>
Apr 14 15:36:45 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:36:45 user nova-compute[71500]:   </features>
Apr 14 15:36:45 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:36:45 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:36:45 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:36:45 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:36:45 user nova-compute[71500]:   </clock>
Apr 14 15:36:45 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:36:45 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:36:45 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:36:45 user nova-compute[71500]:   </cpu>
Apr 14 15:36:45 user nova-compute[71500]:   <devices>
Apr 14 15:36:45 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:36:45 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:36:45 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk"/>
Apr 14 15:36:45 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:36:45 user nova-compute[71500]:     </disk>
Apr 14 15:36:45 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:36:45 user nova-compute[71500]:       <mac address="fa:16:3e:94:b5:6d"/>
Apr 14 15:36:45 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:45 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:36:45 user nova-compute[71500]:       <target dev="tape04c622c-58"/>
Apr 14 15:36:45 user nova-compute[71500]:     </interface>
Apr 14 15:36:45 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:36:45 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/console.log" append="off"/>
Apr 14 15:36:45 user nova-compute[71500]:     </serial>
Apr 14 15:36:45 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:36:45 user nova-compute[71500]:     <video>
Apr 14 15:36:45 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:45 user nova-compute[71500]:     </video>
Apr 14 15:36:45 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:36:45 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:36:45 user nova-compute[71500]:     </rng>
Apr 14 15:36:45 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:36:45 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:36:45 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:36:45 user nova-compute[71500]:     </memballoon>
Apr 14 15:36:45 user nova-compute[71500]:   </devices>
Apr 14 15:36:45 user nova-compute[71500]: </domain>
Apr 14 15:36:45 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1391704245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1391704245',id=3,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-yo4f6s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:38Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=d8e21d6b-fc8f-4373-a54f-452ab5fa169c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG os_vif [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape04c622c-58, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape04c622c-58, col_values=(('external_ids', {'iface-id': 'e04c622c-58ef-477e-8d37-eb052355492e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:b5:6d', 'vm-uuid': 'd8e21d6b-fc8f-4373-a54f-452ab5fa169c'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:45 user nova-compute[71500]: INFO os_vif [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58')
Apr 14 15:36:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No VIF found with MAC fa:16:3e:94:b5:6d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:36:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Creating image(s)
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.policy [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f805db20d87d4429981c975ebd88ed92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8230c5386464f288fd783b3c60536b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk 1073741824" returned: 0 in 0.040s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:36:46 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Creating image(s)
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.policy [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Cannot resize image /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'migration_context' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Ensure instance console log exists: /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk 1073741824" returned: 0 in 0.044s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:36:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updated VIF entry in instance network info cache for port 29225f48-b889-4b7d-b5be-6c47f5c4b076. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updating instance_info_cache with network_info: [{"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fe0d8e00-1fa0-4069-9a0c-805ad6381f23 req-b41dedfe-dad5-4f71-bcd2-23859b3c95c7 service nova] Releasing lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Cannot resize image /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'migration_context' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Ensure instance console log exists: /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:36:47 user nova-compute[71500]: INFO nova.compute.claims [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Claim successful on node user
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:36:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:36:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Creating image(s)
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updated VIF entry in instance network info cache for port e04c622c-58ef-477e-8d37-eb052355492e. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updating instance_info_cache with network_info: [{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG nova.policy [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f2be0028-fd80-4cd3-82d8-9ee25715944b req-26af5eb8-e51e-4aa5-aa71-0a487b8b911d service nova] Releasing lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.126s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.119s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk 1073741824" returned: 0 in 0.087s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.124s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Cannot resize image /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'migration_context' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Ensure instance console log exists: /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Successfully created port: e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] No waiting events found dispatching network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:49 user nova-compute[71500]: WARNING nova.compute.manager [req-29c67889-9319-4cf3-b229-89b6ebbf4f27 req-7834e3d1-dc81-448a-8003-d79aa8fc7c1e service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received unexpected event network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance with vm_state building and task_state spawning.
Apr 14 15:36:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] No waiting events found dispatching network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:49 user nova-compute[71500]: WARNING nova.compute.manager [req-1b451a2c-a361-44b9-aa97-e936f11c284d req-3bb916dd-4541-4311-9f1b-06ce51997b6f service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received unexpected event network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e for instance with vm_state building and task_state spawning.
Apr 14 15:36:50 user nova-compute[71500]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Successfully created port: cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:36:50 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Successfully created port: 7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:36:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Successfully updated port: e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486611.111525, d8e21d6b-fc8f-4373-a54f-452ab5fa169c => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] VM Resumed (Lifecycle Event)
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Instance spawned successfully.
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Instance spawned successfully.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Instance spawned successfully.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486611.1118214, d8e21d6b-fc8f-4373-a54f-452ab5fa169c => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] VM Started (Lifecycle Event)
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Took 13.40 seconds to spawn the instance on the hypervisor.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Took 18.09 seconds to spawn the instance on the hypervisor.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Took 15.97 seconds to spawn the instance on the hypervisor.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486611.1120172, 0339b7d6-294b-4669-9782-51de5748226a => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] VM Resumed (Lifecycle Event)
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Took 14.36 seconds to build instance.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e8ace72d-1d13-4a60-8ed6-47660d872284 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.547s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Took 17.13 seconds to build instance.
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Took 19.03 seconds to build instance.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] No waiting events found dispatching network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:51 user nova-compute[71500]: WARNING nova.compute.manager [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received unexpected event network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance with vm_state active and task_state None.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] No waiting events found dispatching network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:51 user nova-compute[71500]: WARNING nova.compute.manager [req-ad4eaf81-5465-42d8-bb67-ef58842b395c req-012d0d91-bfd5-4065-b86d-7e5b2c64cb9b service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received unexpected event network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance with vm_state active and task_state None.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c5305b67-bfa0-420f-b6bd-f6cf06e4d5ee tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "0339b7d6-294b-4669-9782-51de5748226a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.287s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ce3aa29f-70f2-4537-a464-dbcaacd6e170 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.253s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486611.1163568, 0339b7d6-294b-4669-9782-51de5748226a => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] VM Started (Lifecycle Event)
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486611.1415777, c66b5102-c56e-4209-afb2-c2594b271af6 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] VM Resumed (Lifecycle Event)
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486611.1424208, c66b5102-c56e-4209-afb2-c2594b271af6 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] VM Started (Lifecycle Event)
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance network_info: |[{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Start _get_guest_xml network_info=[{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:36:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:36:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-797939149',display_name='tempest-ServerRescueNegativeTestJSON-server-797939149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-797939149',id=5,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-4lrfed09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:46Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=0f27f459-5b11-4564-ab4c-7194b18319f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:36:52 user nova-compute[71500]:   <uuid>0f27f459-5b11-4564-ab4c-7194b18319f4</uuid>
Apr 14 15:36:52 user nova-compute[71500]:   <name>instance-00000005</name>
Apr 14 15:36:52 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:36:52 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:36:52 user nova-compute[71500]:   <metadata>
Apr 14 15:36:52 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:36:52 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:36:52 user nova-compute[71500]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-797939149</nova:name>
Apr 14 15:36:52 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:36:51</nova:creationTime>
Apr 14 15:36:52 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:36:52 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:36:52 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:36:52 user nova-compute[71500]:       <nova:owner>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:user uuid="3fa924fefda1428d81152fd573540f26">tempest-ServerRescueNegativeTestJSON-1174024196-project-member</nova:user>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:project uuid="609ac7b149e14baab270d83a2646fbdf">tempest-ServerRescueNegativeTestJSON-1174024196</nova:project>
Apr 14 15:36:52 user nova-compute[71500]:       </nova:owner>
Apr 14 15:36:52 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:36:52 user nova-compute[71500]:       <nova:ports>
Apr 14 15:36:52 user nova-compute[71500]:         <nova:port uuid="e9820d0e-cb0f-4d8e-b071-3c6c616bf863">
Apr 14 15:36:52 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 15:36:52 user nova-compute[71500]:         </nova:port>
Apr 14 15:36:52 user nova-compute[71500]:       </nova:ports>
Apr 14 15:36:52 user nova-compute[71500]:     </nova:instance>
Apr 14 15:36:52 user nova-compute[71500]:   </metadata>
Apr 14 15:36:52 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:36:52 user nova-compute[71500]:     <system>
Apr 14 15:36:52 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:36:52 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:36:52 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:36:52 user nova-compute[71500]:       <entry name="serial">0f27f459-5b11-4564-ab4c-7194b18319f4</entry>
Apr 14 15:36:52 user nova-compute[71500]:       <entry name="uuid">0f27f459-5b11-4564-ab4c-7194b18319f4</entry>
Apr 14 15:36:52 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:36:52 user nova-compute[71500]:     </system>
Apr 14 15:36:52 user nova-compute[71500]:   </sysinfo>
Apr 14 15:36:52 user nova-compute[71500]:   <os>
Apr 14 15:36:52 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:36:52 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:36:52 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:36:52 user nova-compute[71500]:   </os>
Apr 14 15:36:52 user nova-compute[71500]:   <features>
Apr 14 15:36:52 user nova-compute[71500]:     <acpi/>
Apr 14 15:36:52 user nova-compute[71500]:     <apic/>
Apr 14 15:36:52 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:36:52 user nova-compute[71500]:   </features>
Apr 14 15:36:52 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:36:52 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:36:52 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:36:52 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:36:52 user nova-compute[71500]:   </clock>
Apr 14 15:36:52 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:36:52 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:36:52 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:36:52 user nova-compute[71500]:   </cpu>
Apr 14 15:36:52 user nova-compute[71500]:   <devices>
Apr 14 15:36:52 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:36:52 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:36:52 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk"/>
Apr 14 15:36:52 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:36:52 user nova-compute[71500]:     </disk>
Apr 14 15:36:52 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:36:52 user nova-compute[71500]:       <mac address="fa:16:3e:ad:84:39"/>
Apr 14 15:36:52 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:52 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:36:52 user nova-compute[71500]:       <target dev="tape9820d0e-cb"/>
Apr 14 15:36:52 user nova-compute[71500]:     </interface>
Apr 14 15:36:52 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:36:52 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/console.log" append="off"/>
Apr 14 15:36:52 user nova-compute[71500]:     </serial>
Apr 14 15:36:52 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:36:52 user nova-compute[71500]:     <video>
Apr 14 15:36:52 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:52 user nova-compute[71500]:     </video>
Apr 14 15:36:52 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:36:52 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:36:52 user nova-compute[71500]:     </rng>
Apr 14 15:36:52 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:36:52 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:36:52 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:36:52 user nova-compute[71500]:     </memballoon>
Apr 14 15:36:52 user nova-compute[71500]:   </devices>
Apr 14 15:36:52 user nova-compute[71500]: </domain>
Apr 14 15:36:52 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-797939149',display_name='tempest-ServerRescueNegativeTestJSON-server-797939149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-797939149',id=5,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-4lrfed09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:46Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=0f27f459-5b11-4564-ab4c-7194b18319f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG os_vif [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9820d0e-cb, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9820d0e-cb, col_values=(('external_ids', {'iface-id': 'e9820d0e-cb0f-4d8e-b071-3c6c616bf863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:84:39', 'vm-uuid': '0f27f459-5b11-4564-ab4c-7194b18319f4'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] No waiting events found dispatching network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:52 user nova-compute[71500]: WARNING nova.compute.manager [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received unexpected event network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e for instance with vm_state active and task_state None.
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-changed-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Refreshing instance network info cache due to event network-changed-e9820d0e-cb0f-4d8e-b071-3c6c616bf863. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Refreshing network info cache for port e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:52 user nova-compute[71500]: INFO os_vif [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb')
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:ad:84:39, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Successfully updated port: 7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-changed-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Refreshing instance network info cache due to event network-changed-7d184083-9af2-4aad-abc5-7d9c28804ee1. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:36:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Acquiring lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] No waiting events found dispatching network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:53 user nova-compute[71500]: WARNING nova.compute.manager [req-08ab5921-841f-4d32-b307-d9fee3feb20d req-b6fddcea-111d-4f6d-b0d9-3b34d7f0a3d1 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received unexpected event network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance with vm_state active and task_state None.
Apr 14 15:36:53 user nova-compute[71500]: DEBUG nova.network.neutron [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updated VIF entry in instance network info cache for port e9820d0e-cb0f-4d8e-b071-3c6c616bf863. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG nova.network.neutron [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-795ec770-7870-40c6-9a5f-0f34efe26da4 req-9372142d-364b-45c5-a877-9c26406f50a6 service nova] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance network_info: |[{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Acquired lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.neutron [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Refreshing network info cache for port 7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Start _get_guest_xml network_info=[{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:36:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1486944866',display_name='tempest-ServerRescueNegativeTestJSON-server-1486944866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1486944866',id=6,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-sdeekh3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:48Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=40b5c2de-9cb2-4bcc-a04a-a4924e51151c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.objects.instance [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'pci_devices' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:36:54 user nova-compute[71500]:   <uuid>40b5c2de-9cb2-4bcc-a04a-a4924e51151c</uuid>
Apr 14 15:36:54 user nova-compute[71500]:   <name>instance-00000006</name>
Apr 14 15:36:54 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:36:54 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:36:54 user nova-compute[71500]:   <metadata>
Apr 14 15:36:54 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:36:54 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:36:54 user nova-compute[71500]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1486944866</nova:name>
Apr 14 15:36:54 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:36:54</nova:creationTime>
Apr 14 15:36:54 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:36:54 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:36:54 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:36:54 user nova-compute[71500]:       <nova:owner>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:user uuid="3fa924fefda1428d81152fd573540f26">tempest-ServerRescueNegativeTestJSON-1174024196-project-member</nova:user>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:project uuid="609ac7b149e14baab270d83a2646fbdf">tempest-ServerRescueNegativeTestJSON-1174024196</nova:project>
Apr 14 15:36:54 user nova-compute[71500]:       </nova:owner>
Apr 14 15:36:54 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:36:54 user nova-compute[71500]:       <nova:ports>
Apr 14 15:36:54 user nova-compute[71500]:         <nova:port uuid="7d184083-9af2-4aad-abc5-7d9c28804ee1">
Apr 14 15:36:54 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 15:36:54 user nova-compute[71500]:         </nova:port>
Apr 14 15:36:54 user nova-compute[71500]:       </nova:ports>
Apr 14 15:36:54 user nova-compute[71500]:     </nova:instance>
Apr 14 15:36:54 user nova-compute[71500]:   </metadata>
Apr 14 15:36:54 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:36:54 user nova-compute[71500]:     <system>
Apr 14 15:36:54 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:36:54 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:36:54 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:36:54 user nova-compute[71500]:       <entry name="serial">40b5c2de-9cb2-4bcc-a04a-a4924e51151c</entry>
Apr 14 15:36:54 user nova-compute[71500]:       <entry name="uuid">40b5c2de-9cb2-4bcc-a04a-a4924e51151c</entry>
Apr 14 15:36:54 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:36:54 user nova-compute[71500]:     </system>
Apr 14 15:36:54 user nova-compute[71500]:   </sysinfo>
Apr 14 15:36:54 user nova-compute[71500]:   <os>
Apr 14 15:36:54 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:36:54 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:36:54 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:36:54 user nova-compute[71500]:   </os>
Apr 14 15:36:54 user nova-compute[71500]:   <features>
Apr 14 15:36:54 user nova-compute[71500]:     <acpi/>
Apr 14 15:36:54 user nova-compute[71500]:     <apic/>
Apr 14 15:36:54 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:36:54 user nova-compute[71500]:   </features>
Apr 14 15:36:54 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:36:54 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:36:54 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:36:54 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:36:54 user nova-compute[71500]:   </clock>
Apr 14 15:36:54 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:36:54 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:36:54 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:36:54 user nova-compute[71500]:   </cpu>
Apr 14 15:36:54 user nova-compute[71500]:   <devices>
Apr 14 15:36:54 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:36:54 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:36:54 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk"/>
Apr 14 15:36:54 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:36:54 user nova-compute[71500]:     </disk>
Apr 14 15:36:54 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:36:54 user nova-compute[71500]:       <mac address="fa:16:3e:8f:0f:83"/>
Apr 14 15:36:54 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:54 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:36:54 user nova-compute[71500]:       <target dev="tap7d184083-9a"/>
Apr 14 15:36:54 user nova-compute[71500]:     </interface>
Apr 14 15:36:54 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:36:54 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/console.log" append="off"/>
Apr 14 15:36:54 user nova-compute[71500]:     </serial>
Apr 14 15:36:54 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:36:54 user nova-compute[71500]:     <video>
Apr 14 15:36:54 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:54 user nova-compute[71500]:     </video>
Apr 14 15:36:54 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:36:54 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:36:54 user nova-compute[71500]:     </rng>
Apr 14 15:36:54 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:36:54 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:36:54 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:36:54 user nova-compute[71500]:     </memballoon>
Apr 14 15:36:54 user nova-compute[71500]:   </devices>
Apr 14 15:36:54 user nova-compute[71500]: </domain>
Apr 14 15:36:54 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1486944866',display_name='tempest-ServerRescueNegativeTestJSON-server-1486944866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1486944866',id=6,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-sdeekh3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:48Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=40b5c2de-9cb2-4bcc-a04a-a4924e51151c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG os_vif [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d184083-9a, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d184083-9a, col_values=(('external_ids', {'iface-id': '7d184083-9af2-4aad-abc5-7d9c28804ee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:0f:83', 'vm-uuid': '40b5c2de-9cb2-4bcc-a04a-a4924e51151c'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: INFO os_vif [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a')
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:8f:0f:83, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Successfully updated port: cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:36:55 user nova-compute[71500]: DEBUG nova.network.neutron [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updated VIF entry in instance network info cache for port 7d184083-9af2-4aad-abc5-7d9c28804ee1. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:36:55 user nova-compute[71500]: DEBUG nova.network.neutron [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1c841ea4-4458-4a51-b47f-82ca7f7f2a12 req-e402b697-3195-4890-b28c-7f896e26a5e7 service nova] Releasing lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing instance network info cache due to event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:56 user nova-compute[71500]: WARNING nova.compute.manager [req-f76aa5eb-4592-45c1-97f9-b48c9ce4b6a2 req-359dddec-747d-45a2-82af-ed22a9baea59 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state building and task_state spawning.
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486616.6677706, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Resumed (Lifecycle Event)
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:36:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance spawned successfully.
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486616.670834, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Started (Lifecycle Event)
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:56 user nova-compute[71500]: INFO nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Took 10.38 seconds to spawn the instance on the hypervisor.
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:36:57 user nova-compute[71500]: INFO nova.compute.manager [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Took 11.67 seconds to build instance.
Apr 14 15:36:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e0efd72-cbe6-489d-bac7-43b5e3643723 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.792s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.network.neutron [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance network_info: |[{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.network.neutron [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Start _get_guest_xml network_info=[{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:36:57 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:57 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-660406846',display_name='tempest-ServerStableDeviceRescueTest-server-660406846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-660406846',id=4,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvPHEwKozg7h6r4JnJpSzBWhs511e+AcMrK/R2mBj8TGR21rZjvip0yg4hAZLhZammhHG2RLycjW8OY5YH3WpdSWl4G97OD9UkFa1PzKidrzi0TtxEVyGAc8SnkIc1I4Q==',key_name='tempest-keypair-985297908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8230c5386464f288fd783b3c60536b4',ramdisk_id='',reservation_id='r-m8khbov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2130046820',owner_user_name='tempest-ServerStableDeviceRescueTest-2130046820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f805db20d87d4429981c975ebd88ed92',uuid=2d91a139-cb0c-40c1-99a1-6b34dcb60bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converting VIF {"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.objects.instance [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:36:57 user nova-compute[71500]:   <uuid>2d91a139-cb0c-40c1-99a1-6b34dcb60bed</uuid>
Apr 14 15:36:57 user nova-compute[71500]:   <name>instance-00000004</name>
Apr 14 15:36:57 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:36:57 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:36:57 user nova-compute[71500]:   <metadata>
Apr 14 15:36:57 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:36:57 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:36:57 user nova-compute[71500]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-660406846</nova:name>
Apr 14 15:36:57 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:36:57</nova:creationTime>
Apr 14 15:36:57 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:36:57 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:36:57 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:36:57 user nova-compute[71500]:       <nova:owner>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:user uuid="f805db20d87d4429981c975ebd88ed92">tempest-ServerStableDeviceRescueTest-2130046820-project-member</nova:user>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:project uuid="a8230c5386464f288fd783b3c60536b4">tempest-ServerStableDeviceRescueTest-2130046820</nova:project>
Apr 14 15:36:57 user nova-compute[71500]:       </nova:owner>
Apr 14 15:36:57 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:36:57 user nova-compute[71500]:       <nova:ports>
Apr 14 15:36:57 user nova-compute[71500]:         <nova:port uuid="cfb03b4e-c244-4ebd-bff5-7e250ac32044">
Apr 14 15:36:57 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:36:57 user nova-compute[71500]:         </nova:port>
Apr 14 15:36:57 user nova-compute[71500]:       </nova:ports>
Apr 14 15:36:57 user nova-compute[71500]:     </nova:instance>
Apr 14 15:36:57 user nova-compute[71500]:   </metadata>
Apr 14 15:36:57 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:36:57 user nova-compute[71500]:     <system>
Apr 14 15:36:57 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:36:57 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:36:57 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:36:57 user nova-compute[71500]:       <entry name="serial">2d91a139-cb0c-40c1-99a1-6b34dcb60bed</entry>
Apr 14 15:36:57 user nova-compute[71500]:       <entry name="uuid">2d91a139-cb0c-40c1-99a1-6b34dcb60bed</entry>
Apr 14 15:36:57 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:36:57 user nova-compute[71500]:     </system>
Apr 14 15:36:57 user nova-compute[71500]:   </sysinfo>
Apr 14 15:36:57 user nova-compute[71500]:   <os>
Apr 14 15:36:57 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:36:57 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:36:57 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:36:57 user nova-compute[71500]:   </os>
Apr 14 15:36:57 user nova-compute[71500]:   <features>
Apr 14 15:36:57 user nova-compute[71500]:     <acpi/>
Apr 14 15:36:57 user nova-compute[71500]:     <apic/>
Apr 14 15:36:57 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:36:57 user nova-compute[71500]:   </features>
Apr 14 15:36:57 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:36:57 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:36:57 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:36:57 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:36:57 user nova-compute[71500]:   </clock>
Apr 14 15:36:57 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:36:57 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:36:57 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:36:57 user nova-compute[71500]:   </cpu>
Apr 14 15:36:57 user nova-compute[71500]:   <devices>
Apr 14 15:36:57 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:36:57 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:36:57 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk"/>
Apr 14 15:36:57 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:36:57 user nova-compute[71500]:     </disk>
Apr 14 15:36:57 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:36:57 user nova-compute[71500]:       <mac address="fa:16:3e:2c:45:27"/>
Apr 14 15:36:57 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:57 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:36:57 user nova-compute[71500]:       <target dev="tapcfb03b4e-c2"/>
Apr 14 15:36:57 user nova-compute[71500]:     </interface>
Apr 14 15:36:57 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:36:57 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/console.log" append="off"/>
Apr 14 15:36:57 user nova-compute[71500]:     </serial>
Apr 14 15:36:57 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:36:57 user nova-compute[71500]:     <video>
Apr 14 15:36:57 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:36:57 user nova-compute[71500]:     </video>
Apr 14 15:36:57 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:36:57 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:36:57 user nova-compute[71500]:     </rng>
Apr 14 15:36:57 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:36:57 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:36:57 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:36:57 user nova-compute[71500]:     </memballoon>
Apr 14 15:36:57 user nova-compute[71500]:   </devices>
Apr 14 15:36:57 user nova-compute[71500]: </domain>
Apr 14 15:36:57 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-660406846',display_name='tempest-ServerStableDeviceRescueTest-server-660406846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-660406846',id=4,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvPHEwKozg7h6r4JnJpSzBWhs511e+AcMrK/R2mBj8TGR21rZjvip0yg4hAZLhZammhHG2RLycjW8OY5YH3WpdSWl4G97OD9UkFa1PzKidrzi0TtxEVyGAc8SnkIc1I4Q==',key_name='tempest-keypair-985297908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8230c5386464f288fd783b3c60536b4',ramdisk_id='',reservation_id='r-m8khbov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2130046820',owner_user_name='tempest-ServerStableDeviceRescueTest-2130046820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f805db20d87d4429981c975ebd88ed92',uuid=2d91a139-cb0c-40c1-99a1-6b34dcb60bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converting VIF {"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG os_vif [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfb03b4e-c2, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcfb03b4e-c2, col_values=(('external_ids', {'iface-id': 'cfb03b4e-c244-4ebd-bff5-7e250ac32044', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:45:27', 'vm-uuid': '2d91a139-cb0c-40c1-99a1-6b34dcb60bed'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: INFO os_vif [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2')
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No VIF found with MAC fa:16:3e:2c:45:27, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:58 user nova-compute[71500]: WARNING nova.compute.manager [req-1f47f4d4-02ea-44fb-9b4c-bb61411e69bf req-5d1b3be0-cc28-4e5f-83c7-4959cd63a675 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state active and task_state None.
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:36:59 user nova-compute[71500]: WARNING nova.compute.manager [req-3ad7acee-3007-4aca-b4fa-283b678816d9 req-3a7e0a99-fa2c-4186-a193-b487844265f9 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state building and task_state spawning.
Apr 14 15:36:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486619.362439, 40b5c2de-9cb2-4bcc-a04a-a4924e51151c => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] VM Resumed (Lifecycle Event)
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance spawned successfully.
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486619.3659647, 40b5c2de-9cb2-4bcc-a04a-a4924e51151c => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] VM Started (Lifecycle Event)
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Took 11.86 seconds to spawn the instance on the hypervisor.
Apr 14 15:36:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:36:59 user nova-compute[71500]: INFO nova.compute.manager [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Took 12.80 seconds to build instance.
Apr 14 15:36:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46c1e09c-b6bb-4f60-8da6-21bf280c3209 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.973s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:00 user nova-compute[71500]: WARNING nova.compute.manager [req-6a246fd4-d1bd-4c1c-b314-536e9d438eb7 req-c6bbcbe0-ee06-41cc-b617-aee020afc53b service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state building and task_state spawning.
Apr 14 15:37:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updated VIF entry in instance network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:00 user nova-compute[71500]: WARNING nova.compute.manager [req-d372c9a5-6e6f-49f8-9d1e-65f1c0d5c478 req-083738b0-c5d9-4905-ac44-1e788a2e9272 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state building and task_state spawning.
Apr 14 15:37:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486622.1931095, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Resumed (Lifecycle Event)
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance spawned successfully.
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486622.1932147, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Started (Lifecycle Event)
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Took 16.50 seconds to spawn the instance on the hypervisor.
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:02 user nova-compute[71500]: INFO nova.compute.manager [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Took 17.47 seconds to build instance.
Apr 14 15:37:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a36b1d5f-0afc-4b79-a0c2-e6825db7e6ce tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.606s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:02 user nova-compute[71500]: WARNING nova.compute.manager [req-e13434ed-b35b-4db2-a607-91d84f70b443 req-2d4b1346-803a-4912-86e8-643cffa800c2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state None.
Apr 14 15:37:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:12 user nova-compute[71500]: INFO nova.compute.claims [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Claim successful on node user
Apr 14 15:37:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:13 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.policy [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:37:13 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Creating image(s)
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "/opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "/opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "/opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.168s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk 1073741824" returned: 0 in 0.064s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:37:13 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Cannot resize image /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'migration_context' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Ensure instance console log exists: /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Successfully created port: 674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Successfully updated port: 674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquired lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-changed-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Refreshing instance network info cache due to event network-changed-674fa5df-38fc-4d44-9f38-fbae08c80e81. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Acquiring lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updating instance_info_cache with network_info: [{"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Releasing lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Instance network_info: |[{"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Acquired lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.network.neutron [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Refreshing network info cache for port 674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Start _get_guest_xml network_info=[{"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:37:16 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:16 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-487888847',display_name='tempest-VolumesAdminNegativeTest-server-487888847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-487888847',id=7,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVb9qsJSLS3Bgfyq6KylCGL6p6wxpntlLqZCZt1R/qL08QarxPv7eu4MozJC3l12xLn6LGwBQgTP4zKdsaYGDeB2GiKSBHU5x054fe5UNG2NcO4opY99adqDnprJnJRQ==',key_name='tempest-keypair-1028605759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='029b8c395f264a86933a9e878c18e0b2',ramdisk_id='',reservation_id='r-jfhcko96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1127532',owner_user_name='tempest-VolumesAdminNegativeTest-1127532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1aa921f86bd4f3b88eb782d5f667816',uuid=f094302b-0730-4754-b9e9-ec203312b8c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converting VIF {"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'pci_devices' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:37:16 user nova-compute[71500]:   <uuid>f094302b-0730-4754-b9e9-ec203312b8c0</uuid>
Apr 14 15:37:16 user nova-compute[71500]:   <name>instance-00000007</name>
Apr 14 15:37:16 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:37:16 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:37:16 user nova-compute[71500]:   <metadata>
Apr 14 15:37:16 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:37:16 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:37:16 user nova-compute[71500]:       <nova:name>tempest-VolumesAdminNegativeTest-server-487888847</nova:name>
Apr 14 15:37:16 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:37:16</nova:creationTime>
Apr 14 15:37:16 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:37:16 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:37:16 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:37:16 user nova-compute[71500]:       <nova:owner>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:user uuid="e1aa921f86bd4f3b88eb782d5f667816">tempest-VolumesAdminNegativeTest-1127532-project-member</nova:user>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:project uuid="029b8c395f264a86933a9e878c18e0b2">tempest-VolumesAdminNegativeTest-1127532</nova:project>
Apr 14 15:37:16 user nova-compute[71500]:       </nova:owner>
Apr 14 15:37:16 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:37:16 user nova-compute[71500]:       <nova:ports>
Apr 14 15:37:16 user nova-compute[71500]:         <nova:port uuid="674fa5df-38fc-4d44-9f38-fbae08c80e81">
Apr 14 15:37:16 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 15:37:16 user nova-compute[71500]:         </nova:port>
Apr 14 15:37:16 user nova-compute[71500]:       </nova:ports>
Apr 14 15:37:16 user nova-compute[71500]:     </nova:instance>
Apr 14 15:37:16 user nova-compute[71500]:   </metadata>
Apr 14 15:37:16 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:37:16 user nova-compute[71500]:     <system>
Apr 14 15:37:16 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:37:16 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:37:16 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:37:16 user nova-compute[71500]:       <entry name="serial">f094302b-0730-4754-b9e9-ec203312b8c0</entry>
Apr 14 15:37:16 user nova-compute[71500]:       <entry name="uuid">f094302b-0730-4754-b9e9-ec203312b8c0</entry>
Apr 14 15:37:16 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:37:16 user nova-compute[71500]:     </system>
Apr 14 15:37:16 user nova-compute[71500]:   </sysinfo>
Apr 14 15:37:16 user nova-compute[71500]:   <os>
Apr 14 15:37:16 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:37:16 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:37:16 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:37:16 user nova-compute[71500]:   </os>
Apr 14 15:37:16 user nova-compute[71500]:   <features>
Apr 14 15:37:16 user nova-compute[71500]:     <acpi/>
Apr 14 15:37:16 user nova-compute[71500]:     <apic/>
Apr 14 15:37:16 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:37:16 user nova-compute[71500]:   </features>
Apr 14 15:37:16 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:37:16 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:37:16 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:37:16 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:37:16 user nova-compute[71500]:   </clock>
Apr 14 15:37:16 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:37:16 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:37:16 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:37:16 user nova-compute[71500]:   </cpu>
Apr 14 15:37:16 user nova-compute[71500]:   <devices>
Apr 14 15:37:16 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:37:16 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:37:16 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk"/>
Apr 14 15:37:16 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:37:16 user nova-compute[71500]:     </disk>
Apr 14 15:37:16 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:37:16 user nova-compute[71500]:       <mac address="fa:16:3e:68:eb:21"/>
Apr 14 15:37:16 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:16 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:37:16 user nova-compute[71500]:       <target dev="tap674fa5df-38"/>
Apr 14 15:37:16 user nova-compute[71500]:     </interface>
Apr 14 15:37:16 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:37:16 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/console.log" append="off"/>
Apr 14 15:37:16 user nova-compute[71500]:     </serial>
Apr 14 15:37:16 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:37:16 user nova-compute[71500]:     <video>
Apr 14 15:37:16 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:16 user nova-compute[71500]:     </video>
Apr 14 15:37:16 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:37:16 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:37:16 user nova-compute[71500]:     </rng>
Apr 14 15:37:16 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:37:16 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:37:16 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:37:16 user nova-compute[71500]:     </memballoon>
Apr 14 15:37:16 user nova-compute[71500]:   </devices>
Apr 14 15:37:16 user nova-compute[71500]: </domain>
Apr 14 15:37:16 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-487888847',display_name='tempest-VolumesAdminNegativeTest-server-487888847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-487888847',id=7,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVb9qsJSLS3Bgfyq6KylCGL6p6wxpntlLqZCZt1R/qL08QarxPv7eu4MozJC3l12xLn6LGwBQgTP4zKdsaYGDeB2GiKSBHU5x054fe5UNG2NcO4opY99adqDnprJnJRQ==',key_name='tempest-keypair-1028605759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='029b8c395f264a86933a9e878c18e0b2',ramdisk_id='',reservation_id='r-jfhcko96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1127532',owner_user_name='tempest-VolumesAdminNegativeTest-1127532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1aa921f86bd4f3b88eb782d5f667816',uuid=f094302b-0730-4754-b9e9-ec203312b8c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converting VIF {"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG os_vif [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap674fa5df-38, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap674fa5df-38, col_values=(('external_ids', {'iface-id': '674fa5df-38fc-4d44-9f38-fbae08c80e81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:eb:21', 'vm-uuid': 'f094302b-0730-4754-b9e9-ec203312b8c0'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:16 user nova-compute[71500]: INFO os_vif [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38')
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No VIF found with MAC fa:16:3e:68:eb:21, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:37:17 user nova-compute[71500]: DEBUG nova.network.neutron [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updated VIF entry in instance network info cache for port 674fa5df-38fc-4d44-9f38-fbae08c80e81. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:37:17 user nova-compute[71500]: DEBUG nova.network.neutron [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updating instance_info_cache with network_info: [{"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-62036669-422a-4532-8a44-2cbb551c3090 req-71cc6893-55b3-4388-b694-84e8bbd696dd service nova] Releasing lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:18 user nova-compute[71500]: INFO nova.compute.claims [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Claim successful on node user
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] No waiting events found dispatching network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:18 user nova-compute[71500]: WARNING nova.compute.manager [req-a6dd2796-9e9a-4ca2-9ba8-7c9029fb377d req-98f78beb-281f-494c-a0a7-9f71101cfcfe service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received unexpected event network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance with vm_state building and task_state spawning.
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:18 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:19 user nova-compute[71500]: INFO nova.compute.claims [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Claim successful on node user
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:37:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Creating image(s)
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "/opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "/opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "/opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.policy [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8903273cb7ea4a0c9831dbcc74361ae2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f84eb038f3914d54a892a6dabdf6f67b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.173s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk 1073741824" returned: 0 in 0.050s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.242s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Cannot resize image /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'migration_context' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Ensure instance console log exists: /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.policy [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4611274a77c4f3a8333771568ce9fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02da33469a7a477b876331e9b846b99a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Creating image(s)
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "/opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "/opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "557b59394bb213603d988dbe0527296d7b1f7411" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "557b59394bb213603d988dbe0527296d7b1f7411" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.part --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.images [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] bcf08c49-d94f-43c3-882d-e1176741d8e1 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.part /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486640.6667197, f094302b-0730-4754-b9e9-ec203312b8c0 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] VM Resumed (Lifecycle Event)
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Instance spawned successfully.
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486640.67981, f094302b-0730-4754-b9e9-ec203312b8c0 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] VM Started (Lifecycle Event)
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] No waiting events found dispatching network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:20 user nova-compute[71500]: WARNING nova.compute.manager [req-b2a5926a-6eca-4d2b-86a0-722d50eafce4 req-3083b037-f25f-4031-8938-a26922409edc service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received unexpected event network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance with vm_state building and task_state spawning.
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Successfully created port: 3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.part /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.converted" returned: 0 in 0.235s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:20 user nova-compute[71500]: INFO nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Took 7.52 seconds to spawn the instance on the hypervisor.
Apr 14 15:37:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "557b59394bb213603d988dbe0527296d7b1f7411" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.854s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:21 user nova-compute[71500]: INFO nova.compute.manager [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Took 8.66 seconds to build instance.
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfaaf22b-4e57-4660-a56d-4ea7786a9b1a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.848s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "557b59394bb213603d988dbe0527296d7b1f7411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "557b59394bb213603d988dbe0527296d7b1f7411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Successfully created port: 9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411,backing_fmt=raw /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411,backing_fmt=raw /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk 1073741824" returned: 0 in 0.064s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "557b59394bb213603d988dbe0527296d7b1f7411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Successfully updated port: 3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:21 user nova-compute[71500]: INFO nova.compute.claims [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Claim successful on node user
Apr 14 15:37:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquired lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Cannot resize image /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'migration_context' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Ensure instance console log exists: /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Successfully updated port: 9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquired lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-changed-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Refreshing instance network info cache due to event network-changed-9cb5e2c1-d5d0-4325-8847-6e18b178afbf. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Acquiring lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updating instance_info_cache with network_info: [{"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Releasing lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Instance network_info: |[{"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Start _get_guest_xml network_info=[{"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:37:22 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:22 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-581725796',display_name='tempest-TestVolumeSwap-server-581725796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-581725796',id=8,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPs0hr2S89qa5HJoTWExnkbcMJl7mVEmKXO1Z43KzeIRd82SH9/UKYZVvEh37jqfaLeW9ytkKTE2z/yCTgCYiPlndaiDPUtYOZHOLYZHmj1s0YcA3j9fEBYOveLu7ycw==',key_name='tempest-keypair-1390268231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f84eb038f3914d54a892a6dabdf6f67b',ramdisk_id='',reservation_id='r-au0352wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-914090000',owner_user_name='tempest-TestVolumeSwap-914090000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8903273cb7ea4a0c9831dbcc74361ae2',uuid=31b57881-e95e-41d5-9f78-61d95ecfd93a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Converting VIF {"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'pci_devices' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:37:22 user nova-compute[71500]:   <uuid>31b57881-e95e-41d5-9f78-61d95ecfd93a</uuid>
Apr 14 15:37:22 user nova-compute[71500]:   <name>instance-00000008</name>
Apr 14 15:37:22 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:37:22 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:37:22 user nova-compute[71500]:   <metadata>
Apr 14 15:37:22 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:37:22 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:name>tempest-TestVolumeSwap-server-581725796</nova:name>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:37:22</nova:creationTime>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:37:22 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:37:22 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:owner>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:user uuid="8903273cb7ea4a0c9831dbcc74361ae2">tempest-TestVolumeSwap-914090000-project-member</nova:user>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:project uuid="f84eb038f3914d54a892a6dabdf6f67b">tempest-TestVolumeSwap-914090000</nova:project>
Apr 14 15:37:22 user nova-compute[71500]:       </nova:owner>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:ports>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:port uuid="3bdad8ab-4716-4bb3-b21e-890e392b5430">
Apr 14 15:37:22 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 15:37:22 user nova-compute[71500]:         </nova:port>
Apr 14 15:37:22 user nova-compute[71500]:       </nova:ports>
Apr 14 15:37:22 user nova-compute[71500]:     </nova:instance>
Apr 14 15:37:22 user nova-compute[71500]:   </metadata>
Apr 14 15:37:22 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:37:22 user nova-compute[71500]:     <system>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="serial">31b57881-e95e-41d5-9f78-61d95ecfd93a</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="uuid">31b57881-e95e-41d5-9f78-61d95ecfd93a</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:37:22 user nova-compute[71500]:     </system>
Apr 14 15:37:22 user nova-compute[71500]:   </sysinfo>
Apr 14 15:37:22 user nova-compute[71500]:   <os>
Apr 14 15:37:22 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:37:22 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:37:22 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:37:22 user nova-compute[71500]:   </os>
Apr 14 15:37:22 user nova-compute[71500]:   <features>
Apr 14 15:37:22 user nova-compute[71500]:     <acpi/>
Apr 14 15:37:22 user nova-compute[71500]:     <apic/>
Apr 14 15:37:22 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:37:22 user nova-compute[71500]:   </features>
Apr 14 15:37:22 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:37:22 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:37:22 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:37:22 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:37:22 user nova-compute[71500]:   </clock>
Apr 14 15:37:22 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:37:22 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:37:22 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:37:22 user nova-compute[71500]:   </cpu>
Apr 14 15:37:22 user nova-compute[71500]:   <devices>
Apr 14 15:37:22 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:37:22 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:37:22 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk"/>
Apr 14 15:37:22 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:37:22 user nova-compute[71500]:     </disk>
Apr 14 15:37:22 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:37:22 user nova-compute[71500]:       <mac address="fa:16:3e:e2:0b:f4"/>
Apr 14 15:37:22 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:22 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:37:22 user nova-compute[71500]:       <target dev="tap3bdad8ab-47"/>
Apr 14 15:37:22 user nova-compute[71500]:     </interface>
Apr 14 15:37:22 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:37:22 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/console.log" append="off"/>
Apr 14 15:37:22 user nova-compute[71500]:     </serial>
Apr 14 15:37:22 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:37:22 user nova-compute[71500]:     <video>
Apr 14 15:37:22 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:22 user nova-compute[71500]:     </video>
Apr 14 15:37:22 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:37:22 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:37:22 user nova-compute[71500]:     </rng>
Apr 14 15:37:22 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:37:22 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:37:22 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:37:22 user nova-compute[71500]:     </memballoon>
Apr 14 15:37:22 user nova-compute[71500]:   </devices>
Apr 14 15:37:22 user nova-compute[71500]: </domain>
Apr 14 15:37:22 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-581725796',display_name='tempest-TestVolumeSwap-server-581725796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-581725796',id=8,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPs0hr2S89qa5HJoTWExnkbcMJl7mVEmKXO1Z43KzeIRd82SH9/UKYZVvEh37jqfaLeW9ytkKTE2z/yCTgCYiPlndaiDPUtYOZHOLYZHmj1s0YcA3j9fEBYOveLu7ycw==',key_name='tempest-keypair-1390268231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f84eb038f3914d54a892a6dabdf6f67b',ramdisk_id='',reservation_id='r-au0352wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-914090000',owner_user_name='tempest-TestVolumeSwap-914090000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8903273cb7ea4a0c9831dbcc74361ae2',uuid=31b57881-e95e-41d5-9f78-61d95ecfd93a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Converting VIF {"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG os_vif [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bdad8ab-47, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bdad8ab-47, col_values=(('external_ids', {'iface-id': '3bdad8ab-4716-4bb3-b21e-890e392b5430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:0b:f4', 'vm-uuid': '31b57881-e95e-41d5-9f78-61d95ecfd93a'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: INFO os_vif [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47')
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.677s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.198s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:22 user nova-compute[71500]: INFO nova.compute.claims [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Claim successful on node user
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] No VIF found with MAC fa:16:3e:e2:0b:f4, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updating instance_info_cache with network_info: [{"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Releasing lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Instance network_info: |[{"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Acquired lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Refreshing network info cache for port 9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Start _get_guest_xml network_info=[{"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:37:11Z,direct_url=<?>,disk_format='qcow2',id=bcf08c49-d94f-43c3-882d-e1176741d8e1,min_disk=0,min_ram=0,name='',owner='2340d04e03254ded9c5a98dfae79551d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:37:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'bcf08c49-d94f-43c3-882d-e1176741d8e1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:37:22 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:22 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:37:11Z,direct_url=<?>,disk_format='qcow2',id=bcf08c49-d94f-43c3-882d-e1176741d8e1,min_disk=0,min_ram=0,name='',owner='2340d04e03254ded9c5a98dfae79551d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:37:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1881974023',display_name='tempest-AttachSCSIVolumeTestJSON-server-1881974023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1881974023',id=9,image_ref='bcf08c49-d94f-43c3-882d-e1176741d8e1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAACMkTQdvaP771MHaqaa+acYdO2/wpe+WaVnIVpCxc1+9acrx0ws40PfVns7FOqGg8PvqZQBCNW1hApCelVmig7oDDClZY+ILL8blZrPBAn3T/D/58PPa2D4eUWFdfROw==',key_name='tempest-keypair-1207070274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02da33469a7a477b876331e9b846b99a',ramdisk_id='',reservation_id='r-ut2omz01',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcf08c49-d94f-43c3-882d-e1176741d8e1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-728467558',owner_user_name='tempest-AttachSCSIVolumeTestJSON-728467558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4611274a77c4f3a8333771568ce9fbc',uuid=5cffd4a1-2cc7-4048-8902-ed914e6f0ff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Converting VIF {"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:37:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Creating image(s)
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "/opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "/opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.policy [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '426c9fdcd462435293f2208229c11458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c377cd3ce1454ed5a6257138350802f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:37:22 user nova-compute[71500]:   <uuid>5cffd4a1-2cc7-4048-8902-ed914e6f0ff3</uuid>
Apr 14 15:37:22 user nova-compute[71500]:   <name>instance-00000009</name>
Apr 14 15:37:22 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:37:22 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:37:22 user nova-compute[71500]:   <metadata>
Apr 14 15:37:22 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:37:22 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1881974023</nova:name>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:37:22</nova:creationTime>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:37:22 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:37:22 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:owner>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:user uuid="e4611274a77c4f3a8333771568ce9fbc">tempest-AttachSCSIVolumeTestJSON-728467558-project-member</nova:user>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:project uuid="02da33469a7a477b876331e9b846b99a">tempest-AttachSCSIVolumeTestJSON-728467558</nova:project>
Apr 14 15:37:22 user nova-compute[71500]:       </nova:owner>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:root type="image" uuid="bcf08c49-d94f-43c3-882d-e1176741d8e1"/>
Apr 14 15:37:22 user nova-compute[71500]:       <nova:ports>
Apr 14 15:37:22 user nova-compute[71500]:         <nova:port uuid="9cb5e2c1-d5d0-4325-8847-6e18b178afbf">
Apr 14 15:37:22 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:37:22 user nova-compute[71500]:         </nova:port>
Apr 14 15:37:22 user nova-compute[71500]:       </nova:ports>
Apr 14 15:37:22 user nova-compute[71500]:     </nova:instance>
Apr 14 15:37:22 user nova-compute[71500]:   </metadata>
Apr 14 15:37:22 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:37:22 user nova-compute[71500]:     <system>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="serial">5cffd4a1-2cc7-4048-8902-ed914e6f0ff3</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="uuid">5cffd4a1-2cc7-4048-8902-ed914e6f0ff3</entry>
Apr 14 15:37:22 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:37:22 user nova-compute[71500]:     </system>
Apr 14 15:37:22 user nova-compute[71500]:   </sysinfo>
Apr 14 15:37:22 user nova-compute[71500]:   <os>
Apr 14 15:37:22 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:37:22 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:37:22 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:37:22 user nova-compute[71500]:   </os>
Apr 14 15:37:22 user nova-compute[71500]:   <features>
Apr 14 15:37:22 user nova-compute[71500]:     <acpi/>
Apr 14 15:37:22 user nova-compute[71500]:     <apic/>
Apr 14 15:37:22 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:37:22 user nova-compute[71500]:   </features>
Apr 14 15:37:22 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:37:22 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:37:22 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:37:22 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:37:22 user nova-compute[71500]:   </clock>
Apr 14 15:37:22 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:37:22 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:37:22 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:37:22 user nova-compute[71500]:   </cpu>
Apr 14 15:37:22 user nova-compute[71500]:   <devices>
Apr 14 15:37:22 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:37:22 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:37:22 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk"/>
Apr 14 15:37:22 user nova-compute[71500]:       <target dev="sda" bus="scsi"/>
Apr 14 15:37:22 user nova-compute[71500]:       <address type="drive" controller="0" unit="0"/>
Apr 14 15:37:22 user nova-compute[71500]:     </disk>
Apr 14 15:37:22 user nova-compute[71500]:     <disk type="file" device="cdrom">
Apr 14 15:37:22 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 15:37:22 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.config"/>
Apr 14 15:37:22 user nova-compute[71500]:       <target dev="sdb" bus="scsi"/>
Apr 14 15:37:22 user nova-compute[71500]:       <address type="drive" controller="0" unit="1"/>
Apr 14 15:37:22 user nova-compute[71500]:     </disk>
Apr 14 15:37:22 user nova-compute[71500]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 15:37:22 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:37:22 user nova-compute[71500]:       <mac address="fa:16:3e:82:17:57"/>
Apr 14 15:37:22 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:22 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:37:22 user nova-compute[71500]:       <target dev="tap9cb5e2c1-d5"/>
Apr 14 15:37:22 user nova-compute[71500]:     </interface>
Apr 14 15:37:22 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:37:22 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/console.log" append="off"/>
Apr 14 15:37:22 user nova-compute[71500]:     </serial>
Apr 14 15:37:22 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:37:22 user nova-compute[71500]:     <video>
Apr 14 15:37:22 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:22 user nova-compute[71500]:     </video>
Apr 14 15:37:22 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:37:22 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:37:22 user nova-compute[71500]:     </rng>
Apr 14 15:37:22 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:37:22 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:37:22 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:37:22 user nova-compute[71500]:     </memballoon>
Apr 14 15:37:22 user nova-compute[71500]:   </devices>
Apr 14 15:37:22 user nova-compute[71500]: </domain>
Apr 14 15:37:22 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1881974023',display_name='tempest-AttachSCSIVolumeTestJSON-server-1881974023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1881974023',id=9,image_ref='bcf08c49-d94f-43c3-882d-e1176741d8e1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAACMkTQdvaP771MHaqaa+acYdO2/wpe+WaVnIVpCxc1+9acrx0ws40PfVns7FOqGg8PvqZQBCNW1hApCelVmig7oDDClZY+ILL8blZrPBAn3T/D/58PPa2D4eUWFdfROw==',key_name='tempest-keypair-1207070274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02da33469a7a477b876331e9b846b99a',ramdisk_id='',reservation_id='r-ut2omz01',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcf08c49-d94f-43c3-882d-e1176741d8e1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-728467558',owner_user_name='tempest-AttachSCSIVolumeTestJSON-728467558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4611274a77c4f3a8333771568ce9fbc',uuid=5cffd4a1-2cc7-4048-8902-ed914e6f0ff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Converting VIF {"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG os_vif [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cb5e2c1-d5, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cb5e2c1-d5, col_values=(('external_ids', {'iface-id': '9cb5e2c1-d5d0-4325-8847-6e18b178afbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:17:57', 'vm-uuid': '5cffd4a1-2cc7-4048-8902-ed914e6f0ff3'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:22 user nova-compute[71500]: INFO os_vif [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5')
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No BDM found with device name sda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No VIF found with MAC fa:16:3e:82:17:57, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:37:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Using config drive
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-changed-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Refreshing instance network info cache due to event network-changed-3bdad8ab-4716-4bb3-b21e-890e392b5430. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Acquiring lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Acquired lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Refreshing network info cache for port 3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.162s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk 1073741824" returned: 0 in 0.069s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Creating config drive at /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.config
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqcs5vbf0 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqcs5vbf0" returned: 0 in 0.073s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.171s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.957s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Cannot resize image /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lazy-loading 'migration_context' on Instance uuid f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Ensure instance console log exists: /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updated VIF entry in instance network info cache for port 9cb5e2c1-d5d0-4325-8847-6e18b178afbf. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updating instance_info_cache with network_info: [{"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-92b85d1b-a24f-4862-b0ff-f73251863690 req-a1431b34-2320-449d-9b6c-92d5e468d58f service nova] Releasing lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.policy [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:37:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Creating image(s)
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Successfully created port: e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.181s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updated VIF entry in instance network info cache for port 3bdad8ab-4716-4bb3-b21e-890e392b5430. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updating instance_info_cache with network_info: [{"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c7a5f28-bbf9-4cef-a9f1-f8e9356b680c req-8bae8a02-3bf2-4930-8f25-0f04f66b49ef service nova] Releasing lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.165s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk 1073741824" returned: 0 in 0.067s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.155s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Cannot resize image /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'migration_context' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Ensure instance console log exists: /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] No waiting events found dispatching network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:24 user nova-compute[71500]: WARNING nova.compute.manager [req-520db906-3649-4054-b51c-a776842dd36d req-da392d0b-f460-4f67-9a10-476860efe145 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received unexpected event network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance with vm_state building and task_state spawning.
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Successfully created port: 1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Successfully updated port: e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "refresh_cache-f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquired lock "refresh_cache-f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-changed-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Refreshing instance network info cache due to event network-changed-e0c2ac1a-629d-4583-af53-a2fa5045c311. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Acquiring lock "refresh_cache-f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Updating instance_info_cache with network_info: [{"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Releasing lock "refresh_cache-f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Instance network_info: |[{"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Acquired lock "refresh_cache-f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Refreshing network info cache for port e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Start _get_guest_xml network_info=[{"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:37:25 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:25 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-130551406',display_name='tempest-VolumesActionsTest-instance-130551406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-130551406',id=10,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c377cd3ce1454ed5a6257138350802f6',ramdisk_id='',reservation_id='r-viaz4o08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1954053616',owner_user_name='tempest-VolumesActionsTest-1954053616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:22Z,user_data=None,user_id='426c9fdcd462435293f2208229c11458',uuid=f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Converting VIF {"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.objects.instance [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lazy-loading 'pci_devices' on Instance uuid f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:37:25 user nova-compute[71500]:   <uuid>f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc</uuid>
Apr 14 15:37:25 user nova-compute[71500]:   <name>instance-0000000a</name>
Apr 14 15:37:25 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:37:25 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:37:25 user nova-compute[71500]:   <metadata>
Apr 14 15:37:25 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:37:25 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:name>tempest-VolumesActionsTest-instance-130551406</nova:name>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:37:25</nova:creationTime>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:37:25 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:37:25 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:owner>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:user uuid="426c9fdcd462435293f2208229c11458">tempest-VolumesActionsTest-1954053616-project-member</nova:user>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:project uuid="c377cd3ce1454ed5a6257138350802f6">tempest-VolumesActionsTest-1954053616</nova:project>
Apr 14 15:37:25 user nova-compute[71500]:       </nova:owner>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:ports>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:port uuid="e0c2ac1a-629d-4583-af53-a2fa5045c311">
Apr 14 15:37:25 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 15:37:25 user nova-compute[71500]:         </nova:port>
Apr 14 15:37:25 user nova-compute[71500]:       </nova:ports>
Apr 14 15:37:25 user nova-compute[71500]:     </nova:instance>
Apr 14 15:37:25 user nova-compute[71500]:   </metadata>
Apr 14 15:37:25 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:37:25 user nova-compute[71500]:     <system>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="serial">f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="uuid">f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:37:25 user nova-compute[71500]:     </system>
Apr 14 15:37:25 user nova-compute[71500]:   </sysinfo>
Apr 14 15:37:25 user nova-compute[71500]:   <os>
Apr 14 15:37:25 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:37:25 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:37:25 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:37:25 user nova-compute[71500]:   </os>
Apr 14 15:37:25 user nova-compute[71500]:   <features>
Apr 14 15:37:25 user nova-compute[71500]:     <acpi/>
Apr 14 15:37:25 user nova-compute[71500]:     <apic/>
Apr 14 15:37:25 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:37:25 user nova-compute[71500]:   </features>
Apr 14 15:37:25 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:37:25 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:37:25 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:37:25 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:37:25 user nova-compute[71500]:   </clock>
Apr 14 15:37:25 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:37:25 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:37:25 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:37:25 user nova-compute[71500]:   </cpu>
Apr 14 15:37:25 user nova-compute[71500]:   <devices>
Apr 14 15:37:25 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:37:25 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:37:25 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk"/>
Apr 14 15:37:25 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:37:25 user nova-compute[71500]:     </disk>
Apr 14 15:37:25 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:37:25 user nova-compute[71500]:       <mac address="fa:16:3e:8d:21:bf"/>
Apr 14 15:37:25 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:25 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:37:25 user nova-compute[71500]:       <target dev="tape0c2ac1a-62"/>
Apr 14 15:37:25 user nova-compute[71500]:     </interface>
Apr 14 15:37:25 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:37:25 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/console.log" append="off"/>
Apr 14 15:37:25 user nova-compute[71500]:     </serial>
Apr 14 15:37:25 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:37:25 user nova-compute[71500]:     <video>
Apr 14 15:37:25 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:25 user nova-compute[71500]:     </video>
Apr 14 15:37:25 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:37:25 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:37:25 user nova-compute[71500]:     </rng>
Apr 14 15:37:25 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:37:25 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:37:25 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:37:25 user nova-compute[71500]:     </memballoon>
Apr 14 15:37:25 user nova-compute[71500]:   </devices>
Apr 14 15:37:25 user nova-compute[71500]: </domain>
Apr 14 15:37:25 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-130551406',display_name='tempest-VolumesActionsTest-instance-130551406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-130551406',id=10,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c377cd3ce1454ed5a6257138350802f6',ramdisk_id='',reservation_id='r-viaz4o08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1954053616',owner_user_name='tempest-VolumesActionsTest-1954053616-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:22Z,user_data=None,user_id='426c9fdcd462435293f2208229c11458',uuid=f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Converting VIF {"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG os_vif [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0c2ac1a-62, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0c2ac1a-62, col_values=(('external_ids', {'iface-id': 'e0c2ac1a-629d-4583-af53-a2fa5045c311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:21:bf', 'vm-uuid': 'f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: INFO os_vif [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62')
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Successfully updated port: 1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquired lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] No VIF found with MAC fa:16:3e:8d:21:bf, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-changed-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Refreshing instance network info cache due to event network-changed-1f6caa20-5ea5-475a-8060-25725837c3c5. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Acquiring lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Updated VIF entry in instance network info cache for port e0c2ac1a-629d-4583-af53-a2fa5045c311. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Updating instance_info_cache with network_info: [{"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cf038197-73af-4541-aa37-d15937c74bfb req-bd8ba35f-9638-4aa6-ac5f-d01d4e113618 service nova] Releasing lock "refresh_cache-f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Releasing lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Instance network_info: |[{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Acquired lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Refreshing network info cache for port 1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Start _get_guest_xml network_info=[{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:37:25 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:25 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'pci_devices' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:37:25 user nova-compute[71500]:   <uuid>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</uuid>
Apr 14 15:37:25 user nova-compute[71500]:   <name>instance-0000000b</name>
Apr 14 15:37:25 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:37:25 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:37:25 user nova-compute[71500]:   <metadata>
Apr 14 15:37:25 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:37:25 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:37:25</nova:creationTime>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:37:25 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:37:25 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:owner>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:37:25 user nova-compute[71500]:       </nova:owner>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:37:25 user nova-compute[71500]:       <nova:ports>
Apr 14 15:37:25 user nova-compute[71500]:         <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:37:25 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:37:25 user nova-compute[71500]:         </nova:port>
Apr 14 15:37:25 user nova-compute[71500]:       </nova:ports>
Apr 14 15:37:25 user nova-compute[71500]:     </nova:instance>
Apr 14 15:37:25 user nova-compute[71500]:   </metadata>
Apr 14 15:37:25 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:37:25 user nova-compute[71500]:     <system>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="serial">112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="uuid">112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:37:25 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:37:25 user nova-compute[71500]:     </system>
Apr 14 15:37:25 user nova-compute[71500]:   </sysinfo>
Apr 14 15:37:25 user nova-compute[71500]:   <os>
Apr 14 15:37:25 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:37:25 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:37:25 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:37:25 user nova-compute[71500]:   </os>
Apr 14 15:37:25 user nova-compute[71500]:   <features>
Apr 14 15:37:25 user nova-compute[71500]:     <acpi/>
Apr 14 15:37:25 user nova-compute[71500]:     <apic/>
Apr 14 15:37:25 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:37:25 user nova-compute[71500]:   </features>
Apr 14 15:37:25 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:37:25 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:37:25 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:37:25 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:37:25 user nova-compute[71500]:   </clock>
Apr 14 15:37:25 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:37:25 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:37:25 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:37:25 user nova-compute[71500]:   </cpu>
Apr 14 15:37:25 user nova-compute[71500]:   <devices>
Apr 14 15:37:25 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:37:25 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:37:25 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk"/>
Apr 14 15:37:25 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:37:25 user nova-compute[71500]:     </disk>
Apr 14 15:37:25 user nova-compute[71500]:     <disk type="file" device="cdrom">
Apr 14 15:37:25 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 15:37:25 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config"/>
Apr 14 15:37:25 user nova-compute[71500]:       <target dev="hda" bus="ide"/>
Apr 14 15:37:25 user nova-compute[71500]:     </disk>
Apr 14 15:37:25 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:37:25 user nova-compute[71500]:       <mac address="fa:16:3e:d3:0a:6d"/>
Apr 14 15:37:25 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:25 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:37:25 user nova-compute[71500]:       <target dev="tap1f6caa20-5e"/>
Apr 14 15:37:25 user nova-compute[71500]:     </interface>
Apr 14 15:37:25 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:37:25 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log" append="off"/>
Apr 14 15:37:25 user nova-compute[71500]:     </serial>
Apr 14 15:37:25 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:37:25 user nova-compute[71500]:     <video>
Apr 14 15:37:25 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:37:25 user nova-compute[71500]:     </video>
Apr 14 15:37:25 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:37:25 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:37:25 user nova-compute[71500]:     </rng>
Apr 14 15:37:25 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:37:25 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:37:25 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:37:25 user nova-compute[71500]:     </memballoon>
Apr 14 15:37:25 user nova-compute[71500]:   </devices>
Apr 14 15:37:25 user nova-compute[71500]: </domain>
Apr 14 15:37:25 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:37:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG os_vif [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f6caa20-5e, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f6caa20-5e, col_values=(('external_ids', {'iface-id': '1f6caa20-5ea5-475a-8060-25725837c3c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:0a:6d', 'vm-uuid': '112ffb8d-fef8-4ffd-991c-626c7e4c85b5'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: INFO os_vif [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e')
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No BDM found with device name hda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No VIF found with MAC fa:16:3e:d3:0a:6d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:37:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Using config drive
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.network.neutron [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updated VIF entry in instance network info cache for port 1f6caa20-5ea5-475a-8060-25725837c3c5. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.network.neutron [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Creating config drive at /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeeukrxu0 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c0c3348-abef-4aab-a388-4a259672e547 req-6d1af2f1-8c49-4f33-99cb-cf880f09eabc service nova] Releasing lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpeeukrxu0" returned: 0 in 0.060s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] No waiting events found dispatching network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:26 user nova-compute[71500]: WARNING nova.compute.manager [req-02f5a539-d65a-4a8c-80d4-cd8ff178faf8 req-1f89ef17-201b-4aa0-bb59-cd1c1e5df6af service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received unexpected event network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance with vm_state building and task_state spawning.
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] No waiting events found dispatching network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:27 user nova-compute[71500]: WARNING nova.compute.manager [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received unexpected event network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance with vm_state building and task_state spawning.
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] No waiting events found dispatching network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:27 user nova-compute[71500]: WARNING nova.compute.manager [req-0074a90d-8932-4f1a-9c4e-00b3faee7ddc req-07cda508-7f60-43bf-9b92-7f92391113fa service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received unexpected event network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance with vm_state building and task_state spawning.
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Skipping network cache update for instance because it is Building. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Skipping network cache update for instance because it is Building. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Skipping network cache update for instance because it is Building. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Skipping network cache update for instance because it is Building. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid c66b5102-c56e-4209-afb2-c2594b271af6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updating instance_info_cache with network_info: [{"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-c66b5102-c56e-4209-afb2-c2594b271af6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:28 user nova-compute[71500]: WARNING nova.compute.manager [req-e3934f0b-8adb-4632-9571-22ad676c9429 req-c1afe538-404c-4376-84e9-6675aca3eddf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 for instance with vm_state building and task_state spawning.
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] No waiting events found dispatching network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:29 user nova-compute[71500]: WARNING nova.compute.manager [req-b1846ad1-5dc0-4d1a-9255-29660e0c0fa3 req-786b53a5-7be5-4270-b389-77ce77ba2d23 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received unexpected event network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance with vm_state building and task_state spawning.
Apr 14 15:37:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486649.2537334, 31b57881-e95e-41d5-9f78-61d95ecfd93a => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] VM Resumed (Lifecycle Event)
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Instance spawned successfully.
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486649.2639654, 31b57881-e95e-41d5-9f78-61d95ecfd93a => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] VM Started (Lifecycle Event)
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Took 10.24 seconds to spawn the instance on the hypervisor.
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Took 11.11 seconds to build instance.
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4800ef76-8031-4e6c-bdd5-234c62d29934 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.223s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486649.9005885, 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] VM Resumed (Lifecycle Event)
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Instance spawned successfully.
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:30 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486649.901237, 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:30 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] VM Started (Lifecycle Event)
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:30 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:30 user nova-compute[71500]: INFO nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Took 10.01 seconds to spawn the instance on the hypervisor.
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:30 user nova-compute[71500]: INFO nova.compute.manager [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Took 11.14 seconds to build instance.
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-74be13c5-9848-4583-b9ea-bda70eb5d907 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.258s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:30 user nova-compute[71500]: WARNING nova.compute.manager [req-dfcf6c4f-e00d-4713-821f-bbccd6278399 req-87fffc78-1af0-4e5d-9323-6ac5e8e53e0d service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 for instance with vm_state building and task_state spawning.
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] No waiting events found dispatching network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:37:31 user nova-compute[71500]: WARNING nova.compute.manager [req-64d16cb9-61be-4a17-8608-d2b19a1e427a req-83931f30-216c-40dd-8f11-27eaba4b7342 service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received unexpected event network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance with vm_state building and task_state spawning.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486651.4822583, f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] VM Resumed (Lifecycle Event)
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Instance spawned successfully.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486651.4901195, f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] VM Started (Lifecycle Event)
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Instance spawned successfully.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486651.666136, 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] VM Resumed (Lifecycle Event)
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Took 9.20 seconds to spawn the instance on the hypervisor.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Took 8.21 seconds to spawn the instance on the hypervisor.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486651.6684623, 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] VM Started (Lifecycle Event)
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Took 9.90 seconds to build instance.
Apr 14 15:37:31 user nova-compute[71500]: INFO nova.compute.manager [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Took 10.41 seconds to build instance.
Apr 14 15:37:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e688d486-22a0-4db3-9bbf-44676608482d tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.064s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b206da2a-32f7-4f2c-90f7-5281be33ff69 tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.659s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:34 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:34 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=26.550376892089844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance c66b5102-c56e-4209-afb2-c2594b271af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f094302b-0730-4754-b9e9-ec203312b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:37:34 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:37:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.648s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:37:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:50 user nova-compute[71500]: INFO nova.compute.claims [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Claim successful on node user
Apr 14 15:37:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:51 user nova-compute[71500]: INFO nova.virt.block_device [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Booting with volume 0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c at /dev/vda
Apr 14 15:37:51 user nova-compute[71500]: DEBUG nova.policy [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '063d123ffa4f4695bcec3583831b6097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dad6fcd223054486a97d9cbc369eff77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:51 user nova-compute[71500]: DEBUG os_brick.utils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:37:51 user nova-compute[71500]: INFO oslo.privsep.daemon [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpflwabbf1/privsep.sock']
Apr 14 15:37:51 user sudo[82498]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpflwabbf1/privsep.sock
Apr 14 15:37:51 user sudo[82498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 15:37:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully created port: a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully created port: a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:53 user sudo[82498]: pam_unix(sudo:session): session closed for user root
Apr 14 15:37:53 user nova-compute[71500]: INFO oslo.privsep.daemon [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Spawned new privsep daemon via rootwrap
Apr 14 15:37:53 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 15:37:53 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 15:37:53 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 15:37:53 user nova-compute[71500]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82501
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03975805-2fbf-4266-9b0f-30021142917e]: (2,) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6b912-a9fd-47e7-940a-ee921ec7222e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:53 user nova-compute[71500]: WARNING os_brick.initiator.connectors.nvmeof [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[834cd7d9-2d2b-4180-9b0c-5104ab264c85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce330cb-a594-49c9-8211-a74317394859]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ad98fd-a113-4c30-9e37-d2d5afdd5b38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:37:53 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26358f5f-a679-4a25-84a3-e0fee06253fc]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG os_brick.utils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== get_connector_properties: return (1810ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating existing volume attachment record: 4b7edd19-1d98-4415-9ef4-3fd7e8b0a795 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully created port: e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:37:53 user nova-compute[71500]: INFO nova.compute.claims [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Claim successful on node user
Apr 14 15:37:53 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:37:53 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:37:54 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:37:54 user nova-compute[71500]: INFO nova.virt.block_device [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Booting with volume 589fab96-d1de-4727-b5f3-99d4eb88c71d at /dev/vda
Apr 14 15:37:54 user nova-compute[71500]: DEBUG os_brick.utils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4f1ed-bef4-4e10-b2e3-c246fae46856]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.policy [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd16729d95f2742578646f5b33dedb48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140cbbc3a56d44eb99f7759080f26fcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce5c38-6771-4cf6-8682-b3de2ce2b7a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4310521-3ceb-41ca-af12-ec5ac524398f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5355e0b9-2251-4ea3-ae73-bac51cca9f50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:37:54 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:37:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86947ce-1273-4fa3-a8af-3eaf04fd97fc]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG os_brick.utils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating existing volume attachment record: ee14c55b-14a9-4296-82c0-9a929e0d00f0 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:37:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully created port: ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully created port: ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully created port: f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully created port: d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-a5007998-31ee-4618-9fde-ab538bbd8e76. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully created port: 6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4ce323ab-d31b-4306-9718-a28b8ed3baeb req-7cfd296b-ef58-49fb-af0c-52395923c745 service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:57 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully created port: 25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:57 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: 6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-6a76a230-e352-46c5-bec1-7d283ac41b19. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port 6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: 67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully created port: a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9327a33d-5b51-4dc1-8620-e0b4fb5f273d req-57b3312f-2c04-44cc-b3aa-fcd0f0d145d4 service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-ee1af132-bea9-465f-8b76-264c96b3f02b. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a5f297f4-aa7c-4543-8128-aa58ab222653 req-f1e17a85-ab97-4c7b-8a14-8b6b9496632b service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: 4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:37:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port 67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-a73bbd65-caef-437c-abd9-6d2ccc977830. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:00 user nova-compute[71500]: INFO nova.virt.block_device [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Booting with volume 0b929b4b-4f60-46e7-8bda-cb3079ee10c5 at /dev/vdb
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG os_brick.utils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[70112a68-39d2-4893-b8f0-adf3e189ab61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba111b6-262a-449b-8c47-98965917379d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d4f096-2a20-46ff-ba89-1aa8d08cb259]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7daccd2-4d4b-4c87-9856-22d55d1826e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:01 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea16fb-9ff1-41a8-a993-6a7dce446d47]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG os_brick.utils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating existing volume attachment record: 18f1df30-4fe6-40a8-943b-bcec4168cd8e {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port 4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-e2de16b7-a60f-4fba-ace4-21ab648d036e. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-a1397aaf-d530-448a-9827-824d37cf44ba. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-007ae4f7-450a-4ec0-90df-560250beb99e req-9afd0e17-04b0-4723-9227-15546eaa2437 service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-de05e2cd-ef9e-4518-9484-b905fd2133eb req-59101956-5619-4549-b5e8-ea129589c568 service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-ecc253cf-3d0b-4f54-8f5b-f3520753f121. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:02 user nova-compute[71500]: INFO nova.virt.block_device [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Booting with volume c3b561cc-fb98-4e4b-ac5a-5f62afb45279 at /dev/vdb
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Successfully updated port: f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG os_brick.utils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7972fdb-158b-429b-8b1a-0a0e358fa3c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6bd19d-391d-4b71-a164-45c9f86b6e00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a107a80-b7f7-4c1c-b7b4-083075dc0473]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc4cfdf-08e4-4467-b76b-334b9355ec0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: 6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:02 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16bea17-68bf-416a-a897-4f9e47427dda]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG os_brick.utils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating existing volume attachment record: 60475cf8-f872-4cd3-9914-3a8011a9db83 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6c46a22f-e425-427a-b973-48f9bd951faa req-ccf505de-da01-43c3-b2ae-4e09e654068a service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: 25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ccf536f-849c-4601-b19d-3036796f0d5a req-0ff2af01-55d0-46b2-b5a6-9704cfc99110 service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Successfully updated port: a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-f10a6caa-5805-4f6b-9082-7835563229c1. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance network_info: |[{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updated VIF entry in instance network info cache for port f10a6caa-5805-4f6b-9082-7835563229c1. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-6092e2c0-2114-4909-aeca-bb8b43a1c220. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance network_info: |[{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port 6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updated VIF entry in instance network info cache for port 6092e2c0-2114-4909-aeca-bb8b43a1c220. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:38:06 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-25141225-c1dd-4587-8056-04b3c44668c6. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port 25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updated VIF entry in instance network info cache for port 25141225-c1dd-4587-8056-04b3c44668c6. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:07 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:08 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updated VIF entry in instance network info cache for port a7786e2f-3d52-4ec4-8e66-9221db2c3e3e. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:38:08 user nova-compute[71500]: DEBUG nova.network.neutron [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-678774b3-41fb-4779-adff-0c5e1c6975df req-9d1fe31f-d1a8-4e05-9b39-aead59fe2a87 service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:09 user nova-compute[71500]: INFO nova.virt.block_device [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Booting with volume e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 at /dev/vdc
Apr 14 15:38:09 user nova-compute[71500]: DEBUG os_brick.utils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a9d4a-de98-48b1-a8a6-6823833474e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71eefd-9dfd-49e6-b4ec-6c515a023009]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ca7b3-eed2-406a-b141-2205fc38d30e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[23442332-ac3b-44fe-96a8-422e9f7716bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:09 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:38:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5d297-64d0-4851-b7da-79de86b1db60]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG os_brick.utils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:09 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating existing volume attachment record: 3666e100-5d20-4cc9-8a63-b10c953f19b1 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:11 user nova-compute[71500]: INFO nova.virt.block_device [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Booting with volume 890966d3-36f7-4957-82e8-fda81c2dcd11 at /dev/vdc
Apr 14 15:38:11 user nova-compute[71500]: DEBUG os_brick.utils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae89f5c-81ad-4d54-ada5-ad66a19e78a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d1ab6b-8d16-4b02-a3d3-9b787856cf97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820b292-722b-40e6-becb-9e385f5ac03f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1b780-0bee-4a92-82f2-1859bdae039e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:11 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:38:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9686a2d9-6c6c-47d2-97a1-b6eb25a0af45]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG os_brick.utils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:11 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating existing volume attachment record: 894f0b2c-cfc7-4fca-b2dd-c4c8e4707d6b {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:38:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:38:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Creating image(s)
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Ensure instance console log exists: /opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Start _get_guest_xml network_info=[{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '4b7edd19-1d98-4415-9ef4-3fd7e8b0a795', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oijOvcFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa', 'attached_at': '', 'detached_at': '', 'volume_id': '0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c', 'serial': '0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '18f1df30-4fe6-40a8-943b-bcec4168cd8e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxuDUWqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa', 'attached_at': '', 'detached_at': '', 'volume_id': '0b929b4b-4f60-46e7-8bda-cb3079ee10c5', 'serial': '0b929b4b-4f60-46e7-8bda-cb3079ee10c5'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '3666e100-5d20-4cc9-8a63-b10c953f19b1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hksVMxgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa', 'attached_at': '', 'detached_at': '', 'volume_id': 'e976a7ef-4ab8-4174-9a2a-c80fb2cafae9', 'serial': 'e976a7ef-4ab8-4174-9a2a-c80fb2cafae9'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:18 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:18 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connector [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Factory for ISCSI on None {{(pid=71500) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oijOvcFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:18 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc40c6aa-582d-4f11-bf27-015868e9ce5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:18 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8240af6d-32fb-49c9-8c81-1483f22cb8e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c] added
Apr 14 15:38:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59fb504-e369-4ee7-9a12-c658e29eb19a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2553e87f-cc3a-4288-87bd-2c938a41daa2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oijOvcFm {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oijOvcFm" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c39191e-28f2-454d-9374-4f50cd22e208]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oijOvcFm'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e564d91a-720c-4c39-965c-3b72975361e2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e653e1fc-3aae-403b-b87d-01616cbb2b80]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:38:18 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:38:18 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 15:38:18 user nova-compute[71500]: 
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d848b09c-e1ea-413a-b45e-645ba334a301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260]
Apr 14 15:38:18 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9992eea-fca5-4a80-ac2e-ce7e8e80cf1f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef559da-b315-4771-bbec-219bbb710621]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6471847c-e101-49cc-85cf-271fa79211fc]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oijOvcFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23932643966306134', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932643966306134', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxuDUWqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:19 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:19 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:19 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f6743-1aaf-415e-9be1-af31ed037fe2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:19 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8258f3-fc50-4bbe-8a8e-f133fbd86cb0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5] added
Apr 14 15:38:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951630b-3193-45b1-80ad-efa4cbde4553]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8591f4-3c5c-4e45-bbbc-82adcaf49787]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxuDUWqt {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxuDUWqt" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb7808-bce0-4b2f-a7cf-448bbdb456cf]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxuDUWqt'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[70869005-d633-4c32-a1b4-ce5ea3859cf9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b74fb-bd94-4d2c-afa7-bb93c4db4b90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:38:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Creating image(s)
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Ensure instance console log exists: /opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Start _get_guest_xml network_info=[{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'ee14c55b-14a9-4296-82c0-9a929e0d00f0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXKCjpGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02f5b99c-b3e0-4601-be25-1c3053d76ef2', 'attached_at': '', 'detached_at': '', 'volume_id': '589fab96-d1de-4727-b5f3-99d4eb88c71d', 'serial': '589fab96-d1de-4727-b5f3-99d4eb88c71d'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '60475cf8-f872-4cd3-9914-3a8011a9db83', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuiMNkxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02f5b99c-b3e0-4601-be25-1c3053d76ef2', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3b561cc-fb98-4e4b-ac5a-5f62afb45279', 'serial': 'c3b561cc-fb98-4e4b-ac5a-5f62afb45279'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '894f0b2c-cfc7-4fca-b2dd-c4c8e4707d6b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kURHBQFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02f5b99c-b3e0-4601-be25-1c3053d76ef2', 'attached_at': '', 'detached_at': '', 'volume_id': '890966d3-36f7-4957-82e8-fda81c2dcd11', 'serial': '890966d3-36f7-4957-82e8-fda81c2dcd11'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:38:19 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:19 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXKCjpGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:19 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[40636cc9-75b2-441e-b768-b780a44b2af3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260]
Apr 14 15:38:19 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbf1fa3-dd71-4508-9730-91bfb0f55577]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a059ef-fe88-48cb-b62a-23bc3beded4d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:20 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:20 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03d9ed-157f-468e-a8b8-11b7aa866dd1]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxuDUWqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23039313036323734', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313036323734', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.079s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:21 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e7b78-f933-4b9a-98f0-88e3a4b39962]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:21 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hksVMxgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd63af6-c280-424f-bbf7-d0cc0e202d6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d] added
Apr 14 15:38:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d5dfc0-8f32-45e1-90ba-cf65a3102e7e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[30537825-1bb7-4bce-ab4d-0c74ce864217]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXKCjpGd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wXKCjpGd" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55e1f17-bd80-4c9a-8ee8-31c59e1f3135]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wXKCjpGd'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[042dd3c8-6bac-46c7-bb5c-59e4edbc1a7f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8f2650-37b4-4d1a-a74f-db7cb158170f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:21 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:21 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af6c94-de16-4c82-8c65-106966462b8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260]
Apr 14 15:38:21 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[741b1d95-18c6-4269-bd52-87eaa7e9b99f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e081fb-405d-4a5a-ab30-50ba8b002181]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:21 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:21 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:21 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:21 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d41d1-8e21-4d22-837a-d236b7df61d2]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXKCjpGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== connect_volume: return (2356ms) {'type': 'block', 'scsi_wwn': '23633613232373731', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633613232373731', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.248s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:22 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6d3416-e379-432d-88e9-b83f729314ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:22 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuiMNkxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d72fee-22ba-488f-b0f2-0677ed7dfade]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9] added
Apr 14 15:38:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9261fbe-4da9-4a40-8bb5-a7d38c44f6f9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d939d0-764d-408d-a1a2-72f5f843aace]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hksVMxgf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hksVMxgf" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dba75d-525e-4856-bca7-472edc18db20]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hksVMxgf'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62d8ce-859e-4077-abfe-eb6108c2e584]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b244a46-6775-4d10-aeef-5d5e114bdca7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b18e68-870e-4ec9-9e1c-0b16dc7ecbf1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260]
Apr 14 15:38:22 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2959356b-d026-4e7d-8001-cccc89d3c150]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45d9bcc-ff22-4654-a5a8-101e25f3e92f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:22 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2dd836-6991-4e9c-bd90-7f2a244d21d1]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hksVMxgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== connect_volume: return (2550ms) {'type': 'block', 'scsi_wwn': '23838633563643761', 'path': '/dev/sde'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838633563643761', 'path': '/dev/sde'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.274s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:23 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1ca4f0-2385-4f7f-b1df-436146d60d5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:23 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lazy-loading 'pci_devices' on Instance uuid f8608ac5-90b2-49e0-b037-93b5a9ed0baa {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6056f8-e7f8-45b1-a69c-8d0090ce4964]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279] added
Apr 14 15:38:23 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:38:23 user nova-compute[71500]:   <uuid>f8608ac5-90b2-49e0-b037-93b5a9ed0baa</uuid>
Apr 14 15:38:23 user nova-compute[71500]:   <name>instance-0000000c</name>
Apr 14 15:38:23 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:38:23 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:38:23 user nova-compute[71500]:   <metadata>
Apr 14 15:38:23 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:38:23 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:38:23 user nova-compute[71500]:       <nova:name>tempest-device-tagging-server-2050643769</nova:name>
Apr 14 15:38:23 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:38:18</nova:creationTime>
Apr 14 15:38:23 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:38:23 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:38:23 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:38:23 user nova-compute[71500]:       <nova:owner>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:user uuid="063d123ffa4f4695bcec3583831b6097">tempest-TaggedBootDevicesTest_v242-2101773777-project-member</nova:user>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:project uuid="dad6fcd223054486a97d9cbc369eff77">tempest-TaggedBootDevicesTest_v242-2101773777</nova:project>
Apr 14 15:38:23 user nova-compute[71500]:       </nova:owner>
Apr 14 15:38:23 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:38:23 user nova-compute[71500]:       <nova:ports>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="a5007998-31ee-4618-9fde-ab538bbd8e76">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="6a76a230-e352-46c5-bec1-7d283ac41b19">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.9" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="a73bbd65-caef-437c-abd9-6d2ccc977830">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="e2de16b7-a60f-4fba-ace4-21ab648d036e">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="ecc253cf-3d0b-4f54-8f5b-f3520753f121">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:         <nova:port uuid="f10a6caa-5805-4f6b-9082-7835563229c1">
Apr 14 15:38:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 15:38:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:23 user nova-compute[71500]:       </nova:ports>
Apr 14 15:38:23 user nova-compute[71500]:     </nova:instance>
Apr 14 15:38:23 user nova-compute[71500]:   </metadata>
Apr 14 15:38:23 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:38:23 user nova-compute[71500]:     <system>
Apr 14 15:38:23 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:38:23 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:38:23 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:38:23 user nova-compute[71500]:       <entry name="serial">f8608ac5-90b2-49e0-b037-93b5a9ed0baa</entry>
Apr 14 15:38:23 user nova-compute[71500]:       <entry name="uuid">f8608ac5-90b2-49e0-b037-93b5a9ed0baa</entry>
Apr 14 15:38:23 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:38:23 user nova-compute[71500]:     </system>
Apr 14 15:38:23 user nova-compute[71500]:   </sysinfo>
Apr 14 15:38:23 user nova-compute[71500]:   <os>
Apr 14 15:38:23 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:38:23 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:38:23 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:38:23 user nova-compute[71500]:   </os>
Apr 14 15:38:23 user nova-compute[71500]:   <features>
Apr 14 15:38:23 user nova-compute[71500]:     <acpi/>
Apr 14 15:38:23 user nova-compute[71500]:     <apic/>
Apr 14 15:38:23 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:38:23 user nova-compute[71500]:   </features>
Apr 14 15:38:23 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:38:23 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:38:23 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:38:23 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:38:23 user nova-compute[71500]:   </clock>
Apr 14 15:38:23 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:38:23 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:38:23 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:38:23 user nova-compute[71500]:   </cpu>
Apr 14 15:38:23 user nova-compute[71500]:   <devices>
Apr 14 15:38:23 user nova-compute[71500]:     <disk type="file" device="cdrom">
Apr 14 15:38:23 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 15:38:23 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/disk.config"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="hda" bus="ide"/>
Apr 14 15:38:23 user nova-compute[71500]:     </disk>
Apr 14 15:38:23 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:38:23 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:23 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <serial>0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c</serial>
Apr 14 15:38:23 user nova-compute[71500]:     </disk>
Apr 14 15:38:23 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:38:23 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:23 user nova-compute[71500]:       <source dev="/dev/sdc"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <serial>0b929b4b-4f60-46e7-8bda-cb3079ee10c5</serial>
Apr 14 15:38:23 user nova-compute[71500]:     </disk>
Apr 14 15:38:23 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:38:23 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:23 user nova-compute[71500]:       <source dev="/dev/sde"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="vdc" bus="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <serial>e976a7ef-4ab8-4174-9a2a-c80fb2cafae9</serial>
Apr 14 15:38:23 user nova-compute[71500]:     </disk>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:17:00:e0"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tapa5007998-31"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:aa:5d:1e"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tap6a76a230-e3"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:ca:b3:98"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tap67aa6a19-38"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:6e:7e:f2"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tapa73bbd65-ca"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:a7:8c:be"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tape2de16b7-a6"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:5e:4b:4a"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tapecc253cf-3d"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:23 user nova-compute[71500]:       <mac address="fa:16:3e:54:0d:e1"/>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:23 user nova-compute[71500]:       <target dev="tapf10a6caa-58"/>
Apr 14 15:38:23 user nova-compute[71500]:     </interface>
Apr 14 15:38:23 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:38:23 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/console.log" append="off"/>
Apr 14 15:38:23 user nova-compute[71500]:     </serial>
Apr 14 15:38:23 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:38:23 user nova-compute[71500]:     <video>
Apr 14 15:38:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:23 user nova-compute[71500]:     </video>
Apr 14 15:38:23 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:38:23 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:38:23 user nova-compute[71500]:     </rng>
Apr 14 15:38:23 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:38:23 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:38:23 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:38:23 user nova-compute[71500]:     </memballoon>
Apr 14 15:38:23 user nova-compute[71500]:   </devices>
Apr 14 15:38:23 user nova-compute[71500]: </domain>
Apr 14 15:38:23 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5007998-31, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5007998-31, col_values=(('external_ids', {'iface-id': 'a5007998-31ee-4618-9fde-ab538bbd8e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:00:e0', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc265d0f-7b37-4e46-98c8-e91e9202d020]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31')
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a76a230-e3, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a76a230-e3, col_values=(('external_ids', {'iface-id': '6a76a230-e352-46c5-bec1-7d283ac41b19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:5d:1e', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[110b5c5c-a6af-42bb-9584-1af0b9f5955c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuiMNkxD {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3')
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zuiMNkxD" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d13a75-0140-4ad1-9c82-3c7d10957993]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zuiMNkxD'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67aa6a19-38, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67aa6a19-38, col_values=(('external_ids', {'iface-id': '67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:b3:98', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe7eac-1022-4c0f-bde5-c30e8d716c85]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38')
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73bbd65-ca, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa73bbd65-ca, col_values=(('external_ids', {'iface-id': 'a73bbd65-caef-437c-abd9-6d2ccc977830', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:7e:f2', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30dd63a-84ad-4878-80be-b399401a97bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca')
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2de16b7-a6, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2de16b7-a6, col_values=(('external_ids', {'iface-id': 'e2de16b7-a60f-4fba-ace4-21ab648d036e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:8c:be', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0339b6f-2407-4069-8bcf-6ef5151608cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260]
Apr 14 15:38:23 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:23 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a97a487-9d06-4946-9b9c-bcf2674206bb]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6')
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecc253cf-3d, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapecc253cf-3d, col_values=(('external_ids', {'iface-id': 'ecc253cf-3d0b-4f54-8f5b-f3520753f121', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:4b:4a', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[79366034-2a13-4071-bb51-a6a288965bbb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:23 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc8fba-dda1-453e-a2e6-bd8b246365b8]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuiMNkxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d')
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf10a6caa-58, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf10a6caa-58, col_values=(('external_ids', {'iface-id': 'f10a6caa-5805-4f6b-9082-7835563229c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:0d:e1', 'vm-uuid': 'f8608ac5-90b2-49e0-b037-93b5a9ed0baa'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:24 user nova-compute[71500]: INFO os_vif [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58')
Apr 14 15:38:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] No BDM found with device name hda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] No VIF found with MAC fa:16:3e:17:00:e0, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] No VIF found with MAC fa:16:3e:a7:8c:be, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Using config drive
Apr 14 15:38:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Creating config drive at /opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/disk.config
Apr 14 15:38:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgs3gem48 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgs3gem48" returned: 0 in 0.053s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== connect_volume: return (2609ms) {'type': 'block', 'scsi_wwn': '23362626365653731', 'path': '/dev/sdf'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362626365653731', 'path': '/dev/sdf'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kURHBQFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:25 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402a37f-caba-4c56-97a7-6c98a14a4873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:25 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2adbec-e92f-43c5-88d8-8f24f54ddaf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11] added
Apr 14 15:38:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lazy-loading 'flavor' on Instance uuid c66b5102-c56e-4209-afb2-c2594b271af6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6be69-06ce-4162-bfae-c24fb40fd040]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd1fbd-aec7-409d-84d6-f77668ffee04]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kURHBQFn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kURHBQFn" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb12823-897e-44e5-935a-2ae36f12f104]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kURHBQFn'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3b242-de6c-4803-b610-97c5bd226e0a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[848d1534-906a-4e93-98d6-2daff4e28610]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[552fcbc0-e06b-46c3-a3d4-030422c973c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260]
Apr 14 15:38:25 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa641341-8771-436e-9deb-f75e17acafb7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c219ce0-5056-4073-af6f-feb40afe812b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79a108c-2b4f-49cd-a2a2-945802854775]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kURHBQFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:25 user nova-compute[71500]: INFO nova.compute.manager [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Attaching volume 32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 to /dev/vdb
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:38:25 user nova-compute[71500]: INFO nova.compute.claims [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Claim successful on node user
Apr 14 15:38:25 user nova-compute[71500]: DEBUG os_brick.utils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9d5028-62c7-4ca2-a4f4-22b7c3cc3a2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc35538-2607-48d8-ae25-c9def1b8709d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[89699e51-4724-4ffa-9a4b-bf8db72503af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9bbc98-3af1-4565-b5be-7b6f77ddb769]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:26 user nova-compute[71500]: WARNING nova.compute.manager [req-fe684330-4c2e-44ce-aec9-3aac4ce76331 req-193069f0-9749-401d-81c4-3ed8122253ff service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 for instance with vm_state building and task_state spawning.
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:38:26 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9589ea-e285-408a-9eef-58fa353580c8]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.utils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updating existing volume attachment record: e38ca499-fe7b-4004-b9e1-7a458e659cfd {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:26 user nova-compute[71500]: WARNING nova.compute.manager [req-f3398706-c762-4bbb-9939-6306bb76d4ee req-56eb0b60-eb25-45e4-b6f3-404adfa619f0 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 for instance with vm_state building and task_state spawning.
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26362323266363637', 'path': '/dev/sdg'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362323266363637', 'path': '/dev/sdg'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lazy-loading 'pci_devices' on Instance uuid 02f5b99c-b3e0-4601-be25-1c3053d76ef2 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:38:26 user nova-compute[71500]:   <uuid>02f5b99c-b3e0-4601-be25-1c3053d76ef2</uuid>
Apr 14 15:38:26 user nova-compute[71500]:   <name>instance-0000000d</name>
Apr 14 15:38:26 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:38:26 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:38:26 user nova-compute[71500]:   <metadata>
Apr 14 15:38:26 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:38:26 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:38:26 user nova-compute[71500]:       <nova:name>tempest-device-tagging-server-1771574519</nova:name>
Apr 14 15:38:26 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:38:19</nova:creationTime>
Apr 14 15:38:26 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:38:26 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:38:26 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:38:26 user nova-compute[71500]:       <nova:owner>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:user uuid="d16729d95f2742578646f5b33dedb48b">tempest-TaggedBootDevicesTest-1487077847-project-member</nova:user>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:project uuid="140cbbc3a56d44eb99f7759080f26fcb">tempest-TaggedBootDevicesTest-1487077847</nova:project>
Apr 14 15:38:26 user nova-compute[71500]:       </nova:owner>
Apr 14 15:38:26 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:38:26 user nova-compute[71500]:       <nova:ports>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="ee1af132-bea9-465f-8b76-264c96b3f02b">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="4df8fbd5-6858-4d05-b89b-9d3a4d9ed773">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="a1397aaf-d530-448a-9827-824d37cf44ba">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.97" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="6092e2c0-2114-4909-aeca-bb8b43a1c220">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="25141225-c1dd-4587-8056-04b3c44668c6">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:         <nova:port uuid="a7786e2f-3d52-4ec4-8e66-9221db2c3e3e">
Apr 14 15:38:26 user nova-compute[71500]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 15:38:26 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:26 user nova-compute[71500]:       </nova:ports>
Apr 14 15:38:26 user nova-compute[71500]:     </nova:instance>
Apr 14 15:38:26 user nova-compute[71500]:   </metadata>
Apr 14 15:38:26 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:38:26 user nova-compute[71500]:     <system>
Apr 14 15:38:26 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:38:26 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:38:26 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:38:26 user nova-compute[71500]:       <entry name="serial">02f5b99c-b3e0-4601-be25-1c3053d76ef2</entry>
Apr 14 15:38:26 user nova-compute[71500]:       <entry name="uuid">02f5b99c-b3e0-4601-be25-1c3053d76ef2</entry>
Apr 14 15:38:26 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:38:26 user nova-compute[71500]:     </system>
Apr 14 15:38:26 user nova-compute[71500]:   </sysinfo>
Apr 14 15:38:26 user nova-compute[71500]:   <os>
Apr 14 15:38:26 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:38:26 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:38:26 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:38:26 user nova-compute[71500]:   </os>
Apr 14 15:38:26 user nova-compute[71500]:   <features>
Apr 14 15:38:26 user nova-compute[71500]:     <acpi/>
Apr 14 15:38:26 user nova-compute[71500]:     <apic/>
Apr 14 15:38:26 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:38:26 user nova-compute[71500]:   </features>
Apr 14 15:38:26 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:38:26 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:38:26 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:38:26 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:38:26 user nova-compute[71500]:   </clock>
Apr 14 15:38:26 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:38:26 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:38:26 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:38:26 user nova-compute[71500]:   </cpu>
Apr 14 15:38:26 user nova-compute[71500]:   <devices>
Apr 14 15:38:26 user nova-compute[71500]:     <disk type="file" device="cdrom">
Apr 14 15:38:26 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 15:38:26 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2/disk.config"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="hda" bus="ide"/>
Apr 14 15:38:26 user nova-compute[71500]:     </disk>
Apr 14 15:38:26 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:38:26 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:26 user nova-compute[71500]:       <source dev="/dev/sdd"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <serial>589fab96-d1de-4727-b5f3-99d4eb88c71d</serial>
Apr 14 15:38:26 user nova-compute[71500]:     </disk>
Apr 14 15:38:26 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:38:26 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:26 user nova-compute[71500]:       <source dev="/dev/sdf"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <serial>c3b561cc-fb98-4e4b-ac5a-5f62afb45279</serial>
Apr 14 15:38:26 user nova-compute[71500]:     </disk>
Apr 14 15:38:26 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:38:26 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:26 user nova-compute[71500]:       <source dev="/dev/sdg"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="vdc" bus="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <serial>890966d3-36f7-4957-82e8-fda81c2dcd11</serial>
Apr 14 15:38:26 user nova-compute[71500]:     </disk>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:08:c8:0a"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tapee1af132-be"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:3b:c6:66"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tap4df8fbd5-68"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:f8:7d:85"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tapa1397aaf-d5"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:06:91:1d"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tapd2bc9ab1-2b"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:95:d2:5f"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tap6092e2c0-21"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:fc:c7:87"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tap25141225-c1"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:26 user nova-compute[71500]:       <mac address="fa:16:3e:e4:bf:40"/>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:26 user nova-compute[71500]:       <target dev="tapa7786e2f-3d"/>
Apr 14 15:38:26 user nova-compute[71500]:     </interface>
Apr 14 15:38:26 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:38:26 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2/console.log" append="off"/>
Apr 14 15:38:26 user nova-compute[71500]:     </serial>
Apr 14 15:38:26 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:38:26 user nova-compute[71500]:     <video>
Apr 14 15:38:26 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:26 user nova-compute[71500]:     </video>
Apr 14 15:38:26 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:38:26 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:38:26 user nova-compute[71500]:     </rng>
Apr 14 15:38:26 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:38:26 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:38:26 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:38:26 user nova-compute[71500]:     </memballoon>
Apr 14 15:38:26 user nova-compute[71500]:   </devices>
Apr 14 15:38:26 user nova-compute[71500]: </domain>
Apr 14 15:38:26 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee1af132-be, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee1af132-be, col_values=(('external_ids', {'iface-id': 'ee1af132-bea9-465f-8b76-264c96b3f02b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:c8:0a', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be')
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4df8fbd5-68, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4df8fbd5-68, col_values=(('external_ids', {'iface-id': '4df8fbd5-6858-4d05-b89b-9d3a4d9ed773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:c6:66', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:26 user nova-compute[71500]: WARNING nova.compute.manager [req-77b306da-1fe5-40ae-9b54-5b78a97663a9 req-6fe5f1e8-125b-4fc1-b60a-62ffbdbd5ec9 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance with vm_state building and task_state spawning.
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68')
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1397aaf-d5, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1397aaf-d5, col_values=(('external_ids', {'iface-id': 'a1397aaf-d530-448a-9827-824d37cf44ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:7d:85', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:38:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.policy [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'af824b840c604223afd90bce17fe1ceb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a8e73ef2ad94e84876def53ddf43da4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:38:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Creating image(s)
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "/opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "/opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5')
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2bc9ab1-2b, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2bc9ab1-2b, col_values=(('external_ids', {'iface-id': 'd2bc9ab1-2b46-4f55-ae7d-fda3f320a70a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:91:1d', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b')
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.179s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6092e2c0-21, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6092e2c0-21, col_values=(('external_ids', {'iface-id': '6092e2c0-2114-4909-aeca-bb8b43a1c220', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:d2:5f', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.187s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21')
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk 1073741824" returned: 0 in 0.060s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25141225-c1, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25141225-c1, col_values=(('external_ids', {'iface-id': '25141225-c1dd-4587-8056-04b3c44668c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c7:87', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1')
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7786e2f-3d, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7786e2f-3d, col_values=(('external_ids', {'iface-id': 'a7786e2f-3d52-4ec4-8e66-9221db2c3e3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:bf:40', 'vm-uuid': '02f5b99c-b3e0-4601-be25-1c3053d76ef2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.165s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Cannot resize image /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lazy-loading 'migration_context' on Instance uuid f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Ensure instance console log exists: /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: INFO os_vif [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d')
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] No BDM found with device name hda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] No VIF found with MAC fa:16:3e:08:c8:0a, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] No VIF found with MAC fa:16:3e:95:d2:5f, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Using config drive
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: INFO nova.compute.manager [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] instance snapshotting
Apr 14 15:38:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Successfully created port: 2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:38:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Beginning live snapshot process
Apr 14 15:38:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Creating config drive at /opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2/disk.config
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl15v2vw1 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-79c914f5-691a-4bb4-8329-e0db01d8b40a req-c14f3a55-fe9d-4692-9e24-b58a94d470f8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl15v2vw1" returned: 0 in 0.076s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-925c2605-7c0b-48dd-bc90-596ecabdfe8a req-f0022387-6939-404a-98d2-737d8a7432d4 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json -f qcow2" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:28 user nova-compute[71500]: WARNING nova.compute.manager [req-40c73414-2bc6-4c14-b254-b51ce7938e80 req-a77c9783-2270-4ec9-b3aa-5bff6b98db84 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 for instance with vm_state building and task_state spawning.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4rss7cl4/675f440f9bcf4ccc881c1a38777895de.delta 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4rss7cl4/675f440f9bcf4ccc881c1a38777895de.delta 1073741824" returned: 0 in 0.051s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 15:38:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71500) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 15:38:28 user nova-compute[71500]: INFO nova.virt.libvirt.host [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] UEFI support detected
Apr 14 15:38:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updating instance_info_cache with network_info: [{"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Successfully updated port: 2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "refresh_cache-f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquired lock "refresh_cache-f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Updating instance_info_cache with network_info: [{"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Releasing lock "refresh_cache-f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Instance network_info: |[{"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Start _get_guest_xml network_info=[{"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:38:29 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:29 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1018319414',display_name='tempest-ServersNegativeTestJSON-server-1018319414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1018319414',id=14,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a8e73ef2ad94e84876def53ddf43da4',ramdisk_id='',reservation_id='r-vsgzs8mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-443911091',owner_user_name='tempest-ServersNegativeTestJSON-443911091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:38:27Z,user_data=None,user_id='af824b840c604223afd90bce17fe1ceb',uuid=f5f1e2d0-08c5-4f11-b90a-7257a14e4e62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converting VIF {"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lazy-loading 'pci_devices' on Instance uuid f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] COPY block job progress, current cursor: 327680 final cursor: 43778048 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:38:29 user nova-compute[71500]:   <uuid>f5f1e2d0-08c5-4f11-b90a-7257a14e4e62</uuid>
Apr 14 15:38:29 user nova-compute[71500]:   <name>instance-0000000e</name>
Apr 14 15:38:29 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:38:29 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:38:29 user nova-compute[71500]:   <metadata>
Apr 14 15:38:29 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:38:29 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:38:29 user nova-compute[71500]:       <nova:name>tempest-ServersNegativeTestJSON-server-1018319414</nova:name>
Apr 14 15:38:29 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:38:29</nova:creationTime>
Apr 14 15:38:29 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:38:29 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:38:29 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:38:29 user nova-compute[71500]:       <nova:owner>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:user uuid="af824b840c604223afd90bce17fe1ceb">tempest-ServersNegativeTestJSON-443911091-project-member</nova:user>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:project uuid="3a8e73ef2ad94e84876def53ddf43da4">tempest-ServersNegativeTestJSON-443911091</nova:project>
Apr 14 15:38:29 user nova-compute[71500]:       </nova:owner>
Apr 14 15:38:29 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:38:29 user nova-compute[71500]:       <nova:ports>
Apr 14 15:38:29 user nova-compute[71500]:         <nova:port uuid="2a5e9f47-a62f-4feb-be9c-2a4bc943c378">
Apr 14 15:38:29 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 15:38:29 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:29 user nova-compute[71500]:       </nova:ports>
Apr 14 15:38:29 user nova-compute[71500]:     </nova:instance>
Apr 14 15:38:29 user nova-compute[71500]:   </metadata>
Apr 14 15:38:29 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:38:29 user nova-compute[71500]:     <system>
Apr 14 15:38:29 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:38:29 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:38:29 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:38:29 user nova-compute[71500]:       <entry name="serial">f5f1e2d0-08c5-4f11-b90a-7257a14e4e62</entry>
Apr 14 15:38:29 user nova-compute[71500]:       <entry name="uuid">f5f1e2d0-08c5-4f11-b90a-7257a14e4e62</entry>
Apr 14 15:38:29 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:38:29 user nova-compute[71500]:     </system>
Apr 14 15:38:29 user nova-compute[71500]:   </sysinfo>
Apr 14 15:38:29 user nova-compute[71500]:   <os>
Apr 14 15:38:29 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:38:29 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:38:29 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:38:29 user nova-compute[71500]:   </os>
Apr 14 15:38:29 user nova-compute[71500]:   <features>
Apr 14 15:38:29 user nova-compute[71500]:     <acpi/>
Apr 14 15:38:29 user nova-compute[71500]:     <apic/>
Apr 14 15:38:29 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:38:29 user nova-compute[71500]:   </features>
Apr 14 15:38:29 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:38:29 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:38:29 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:38:29 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:38:29 user nova-compute[71500]:   </clock>
Apr 14 15:38:29 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:38:29 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:38:29 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:38:29 user nova-compute[71500]:   </cpu>
Apr 14 15:38:29 user nova-compute[71500]:   <devices>
Apr 14 15:38:29 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:38:29 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:38:29 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk"/>
Apr 14 15:38:29 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:38:29 user nova-compute[71500]:     </disk>
Apr 14 15:38:29 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:29 user nova-compute[71500]:       <mac address="fa:16:3e:b3:37:43"/>
Apr 14 15:38:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:29 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:29 user nova-compute[71500]:       <target dev="tap2a5e9f47-a6"/>
Apr 14 15:38:29 user nova-compute[71500]:     </interface>
Apr 14 15:38:29 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:38:29 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/console.log" append="off"/>
Apr 14 15:38:29 user nova-compute[71500]:     </serial>
Apr 14 15:38:29 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:38:29 user nova-compute[71500]:     <video>
Apr 14 15:38:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:29 user nova-compute[71500]:     </video>
Apr 14 15:38:29 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:38:29 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:38:29 user nova-compute[71500]:     </rng>
Apr 14 15:38:29 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:38:29 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:38:29 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:38:29 user nova-compute[71500]:     </memballoon>
Apr 14 15:38:29 user nova-compute[71500]:   </devices>
Apr 14 15:38:29 user nova-compute[71500]: </domain>
Apr 14 15:38:29 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1018319414',display_name='tempest-ServersNegativeTestJSON-server-1018319414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1018319414',id=14,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a8e73ef2ad94e84876def53ddf43da4',ramdisk_id='',reservation_id='r-vsgzs8mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-443911091',owner_user_name='tempest-ServersNegativeTestJSON-443911091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:38:27Z,user_data=None,user_id='af824b840c604223afd90bce17fe1ceb',uuid=f5f1e2d0-08c5-4f11-b90a-7257a14e4e62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converting VIF {"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG os_vif [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a5e9f47-a6, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a5e9f47-a6, col_values=(('external_ids', {'iface-id': '2a5e9f47-a62f-4feb-be9c-2a4bc943c378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:37:43', 'vm-uuid': 'f5f1e2d0-08c5-4f11-b90a-7257a14e4e62'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: INFO os_vif [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6')
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] No VIF found with MAC fa:16:3e:b3:37:43, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:38:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-changed-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Refreshing instance network info cache due to event network-changed-2a5e9f47-a62f-4feb-be9c-2a4bc943c378. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Acquiring lock "refresh_cache-f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Acquired lock "refresh_cache-f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Refreshing network info cache for port 2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:30 user nova-compute[71500]: WARNING nova.compute.manager [req-6a6b1162-9e9a-4b39-bdb2-9d636fb7a4ec req-8453f75d-a474-4d31-8375-2deb6ba08e82 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 for instance with vm_state building and task_state spawning.
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:38:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4rss7cl4/675f440f9bcf4ccc881c1a38777895de.delta /opt/stack/data/nova/instances/snapshots/tmp4rss7cl4/675f440f9bcf4ccc881c1a38777895de {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Updated VIF entry in instance network info cache for port 2a5e9f47-a62f-4feb-be9c-2a4bc943c378. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Updating instance_info_cache with network_info: [{"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39390ca1-964d-4c9c-92d8-df33e1dcb668 req-6fef67d0-6ac5-43b5-9f4f-9dfa95d8ed27 service nova] Releasing lock "refresh_cache-f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4rss7cl4/675f440f9bcf4ccc881c1a38777895de.delta /opt/stack/data/nova/instances/snapshots/tmp4rss7cl4/675f440f9bcf4ccc881c1a38777895de" returned: 0 in 0.280s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Snapshot extracted, beginning image upload
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486711.4616864, f8608ac5-90b2-49e0-b037-93b5a9ed0baa => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] VM Resumed (Lifecycle Event)
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance spawned successfully.
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486711.4641857, f8608ac5-90b2-49e0-b037-93b5a9ed0baa => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] VM Started (Lifecycle Event)
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Took 13.36 seconds to spawn the instance on the hypervisor.
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:31 user nova-compute[71500]: INFO nova.compute.manager [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Took 41.05 seconds to build instance.
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-12fc07c8-f326-4845-9b91-827720bc7d7b tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.157s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTaZEmUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:31 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:31 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:31 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff29c338-0514-49de-9fb6-cf466d9f7ba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:38:31 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[412013e1-f29a-4d6d-889e-e8fca928109d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6] added
Apr 14 15:38:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc4b8a-9ca9-4f44-9c50-4b06fbe74b60]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[301804f6-3476-401a-91ba-d6ca1c85a2f8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTaZEmUv {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTaZEmUv" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db8661-3197-4452-a91a-ddeb29a82bc4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTaZEmUv'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef13b8-a51f-444b-bd27-7c99ec4bf6bb]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[230dc3d5-40b5-4629-8f88-bfa15bd75192]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f62e60-f73e-4892-b91e-3e3c46238727]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260]
Apr 14 15:38:32 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488ee2b-df62-446b-b1cd-82c905a83588]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3cc364-9983-49c2-aaef-2423e4cca2b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 (non-flash)
Apr 14 15:38:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f69aabf-449c-47ad-beb5-2ccc7766ce05]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:32 user nova-compute[71500]: WARNING nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance with vm_state building and task_state spawning.
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:32 user nova-compute[71500]: WARNING nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance with vm_state building and task_state spawning.
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:32 user nova-compute[71500]: WARNING nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba for instance with vm_state building and task_state spawning.
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:32 user nova-compute[71500]: WARNING nova.compute.manager [req-90784c04-a685-4c85-a145-04d17304678a req-a59e6301-34cd-4c43-899c-aef0d3f6e8c8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba for instance with vm_state building and task_state spawning.
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:32 user nova-compute[71500]: WARNING nova.compute.manager [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b for instance with vm_state building and task_state spawning.
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:32 user nova-compute[71500]: WARNING nova.compute.manager [req-2cef26ea-0827-4d95-8f04-6f0b2b12b9c6 req-791a919a-24f7-49db-a477-3fff0287e273 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b for instance with vm_state building and task_state spawning.
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTaZEmUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23932376161623761', 'path': '/dev/sdh'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932376161623761', 'path': '/dev/sdh'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lazy-loading 'flavor' on Instance uuid c66b5102-c56e-4209-afb2-c2594b271af6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:38:33 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:38:33 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:38:33 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:38:33 user nova-compute[71500]:   <serial>32a1af86-5017-4ea9-a4c5-15ac5b26cdd6</serial>
Apr 14 15:38:33 user nova-compute[71500]: </disk>
Apr 14 15:38:33 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:33 user nova-compute[71500]: WARNING nova.compute.manager [req-b9696ccb-3355-450b-90f2-871d922bcf32 req-ff1e4eec-9aba-4e73-8cd5-bb5f5f9c3d51 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 for instance with vm_state building and task_state spawning.
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Snapshot image upload complete
Apr 14 15:38:34 user nova-compute[71500]: INFO nova.compute.manager [None req-a3655e79-e33d-4f9d-8c89-bf4b8817323f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Took 6.05 seconds to snapshot the instance on the hypervisor.
Apr 14 15:38:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] No VIF found with MAC fa:16:3e:dc:23:60, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2978eae9-b455-489a-b91b-1d798dd6a968 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.881s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] No waiting events found dispatching network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:34 user nova-compute[71500]: WARNING nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received unexpected event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance with vm_state building and task_state spawning.
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] No waiting events found dispatching network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:34 user nova-compute[71500]: WARNING nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received unexpected event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance with vm_state building and task_state spawning.
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:34 user nova-compute[71500]: WARNING nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance with vm_state building and task_state spawning.
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:34 user nova-compute[71500]: WARNING nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance with vm_state building and task_state spawning.
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:34 user nova-compute[71500]: WARNING nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance with vm_state building and task_state spawning.
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:34 user nova-compute[71500]: WARNING nova.compute.manager [req-5226584e-def2-462a-81ac-ba22bd75aefb req-21b0621b-63aa-4a58-8565-8c7ab5e4f037 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance with vm_state building and task_state spawning.
Apr 14 15:38:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:35 user nova-compute[71500]: WARNING nova.compute.manager [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance with vm_state building and task_state spawning.
Apr 14 15:38:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:35 user nova-compute[71500]: WARNING nova.compute.manager [req-ba57a231-88a0-4b68-9533-d5e0fd6ae9f3 req-f89b69bc-2637-4876-8f98-c04b76a1f734 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance with vm_state building and task_state spawning.
Apr 14 15:38:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:35 user nova-compute[71500]: WARNING nova.compute.manager [req-224684c9-35ad-474d-afb0-aa0739509e64 req-34061b1e-6a7e-425b-97d0-55c549aed52a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 for instance with vm_state building and task_state spawning.
Apr 14 15:38:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:36 user nova-compute[71500]: INFO nova.compute.manager [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Terminating instance
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486716.8257484, f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] VM Resumed (Lifecycle Event)
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:36 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Instance spawned successfully.
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:38:36 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486716.8353584, f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] VM Started (Lifecycle Event)
Apr 14 15:38:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Took 10.27 seconds to spawn the instance on the hypervisor.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-vif-unplugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] No waiting events found dispatching network-vif-unplugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-3d68fcc7-64a9-48cf-b7da-caa0d1988e21 req-b3df4d13-28a1-4739-a4ab-ba036248771b service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-vif-unplugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Took 11.78 seconds to build instance.
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Instance destroyed successfully.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lazy-loading 'resources' on Instance uuid c66b5102-c56e-4209-afb2-c2594b271af6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bfce715c-27be-419b-9829-0a2938078ff0 tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.889s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-725322254',display_name='tempest-DeleteServersTestJSON-server-725322254',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-725322254',id=1,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef8097227d514468b100a6a637bb6287',ramdisk_id='',reservation_id='r-mzaglqaa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-182432264',owner_user_name='tempest-DeleteServersTestJSON-182432264-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:36:51Z,user_data=None,user_id='556b4bd256ee41398d5fd89ef2191550',uuid=c66b5102-c56e-4209-afb2-c2594b271af6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Converting VIF {"id": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "address": "fa:16:3e:dc:23:60", "network": {"id": "ea6d4df1-4011-4c69-88e2-db5315873558", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-411820025-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef8097227d514468b100a6a637bb6287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b57e07f-f5", "ovs_interfaceid": "4b57e07f-f5a9-4524-9f4a-f97133808b99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_vif [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b57e07f-f5, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:37 user nova-compute[71500]: INFO os_vif [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:23:60,bridge_name='br-int',has_traffic_filtering=True,id=4b57e07f-f5a9-4524-9f4a-f97133808b99,network=Network(ea6d4df1-4011-4c69-88e2-db5315873558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b57e07f-f5')
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTaZEmUv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:38:37 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a0b71d-accc-4172-88b5-b033b1d343c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:38:37 user nova-compute[71500]: No targets found.
Apr 14 15:38:37 user nova-compute[71500]: iSNS:
Apr 14 15:38:37 user nova-compute[71500]: No targets found.
Apr 14 15:38:37 user nova-compute[71500]: STATIC:
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:38:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:38:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:38:37 user nova-compute[71500]: FIRMWARE:
Apr 14 15:38:37 user nova-compute[71500]: No targets found.
Apr 14 15:38:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:38:37 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:38:37 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b720372-57ae-4383-897c-ac3b727d48d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3f3da-0392-41be-a04a-2c42ed411f55]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 (non-flash)
Apr 14 15:38:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc1127a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6'): ({'sdh'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Removing single pathed devices sdh {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486717.4888604, 02f5b99c-b3e0-4601-be25-1c3053d76ef2 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] VM Resumed (Lifecycle Event)
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e78f23-9ddb-455c-ab7c-bf8d94c16aff]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[064364a2-31dd-47a0-85f1-21c314a2180b]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Flushing IO for device /dev/sdh {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Rescuing
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fec0369-3c11-4ee6-a7e1-491041ba14c9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance spawned successfully.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adc7cdd-ada1-40c9-9968-e3cceca8106b]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486717.4905329, 02f5b99c-b3e0-4601-be25-1c3053d76ef2 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] VM Started (Lifecycle Event)
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1a2706-b87f-4e1c-b8f6-9e8008d2ca93]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c64379a-c398-4e99-9383-a376d1a10f09]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260]
Apr 14 15:38:37 user nova-compute[71500]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6, portal: 172.16.0.220,3260] successful.
Apr 14 15:38:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Took 17.94 seconds to spawn the instance on the hypervisor.
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a1af86-5017-4ea9-a4c5-15ac5b26cdd6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0007bcd8-2e39-4255-abda-cb734ed479b0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.599s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] <== disconnect_volume: return (600ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:38:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Deleting instance files /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6_del
Apr 14 15:38:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Deletion of /opt/stack/data/nova/instances/c66b5102-c56e-4209-afb2-c2594b271af6_del complete
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing instance network info cache due to event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:38:38 user nova-compute[71500]: INFO nova.compute.manager [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Took 1.73 seconds to destroy the instance on the hypervisor.
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:38 user nova-compute[71500]: INFO nova.compute.manager [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Took 44.59 seconds to build instance.
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5187e804-6ffb-4392-b4c6-674689d2288a tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.703s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:38 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid 'c66b5102-c56e-4209-afb2-c2594b271af6' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c66b5102-c56e-4209-afb2-c2594b271af6' (instance-00000001)
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-vif-deleted-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:38 user nova-compute[71500]: INFO nova.compute.manager [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Neutron deleted interface 4b57e07f-f5a9-4524-9f4a-f97133808b99; detaching it from the instance and deleting it from the info cache
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:38 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Took 0.84 seconds to deallocate network for instance.
Apr 14 15:38:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-67238632-ac01-451c-8f29-17875c355e09 req-43ce6aee-d386-4d37-863c-b2c47fa61a98 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Detach interface failed, port_id=4b57e07f-f5a9-4524-9f4a-f97133808b99, reason: Instance c66b5102-c56e-4209-afb2-c2594b271af6 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG nova.compute.manager [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received event network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Acquiring lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] Lock "c66b5102-c56e-4209-afb2-c2594b271af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] No waiting events found dispatching network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:39 user nova-compute[71500]: WARNING nova.compute.manager [req-c55c435e-bc7d-46c1-aa87-7bf9b7c990c4 req-93269f36-e3ea-48af-94cd-f6847fe13678 service nova] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Received unexpected event network-vif-plugged-4b57e07f-f5a9-4524-9f4a-f97133808b99 for instance with vm_state active and task_state deleting.
Apr 14 15:38:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updated VIF entry in instance network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:38:39 user nova-compute[71500]: INFO nova.compute.manager [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] instance snapshotting
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ff908883-de6c-45c5-bc7f-6ce1efbc8acc req-272902d4-8c19-452d-87d3-df0583a6255f service nova] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:38:39 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Beginning live snapshot process
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:39 user nova-compute[71500]: INFO nova.compute.manager [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Took 0.99 seconds to detach 1 volumes for instance.
Apr 14 15:38:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-unplugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-unplugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:40 user nova-compute[71500]: WARNING nova.compute.manager [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-unplugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state active and task_state rescuing.
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:40 user nova-compute[71500]: WARNING nova.compute.manager [req-a9850343-bee4-4cce-84fd-435d839448a6 req-2db3d098-d9f1-4572-a016-20b880d48282 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state active and task_state rescuing.
Apr 14 15:38:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance destroyed successfully.
Apr 14 15:38:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Attempting rescue
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71500) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:38:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Creating image(s)
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.215s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3p1c7qej/c63d421b9fa443669555e47936d8d7c2.delta 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3p1c7qej/c63d421b9fa443669555e47936d8d7c2.delta 1073741824" returned: 0 in 0.053s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.179s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue" returned: 0 in 0.055s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'migration_context' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Start _get_guest_xml network_info=[{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:8f:0f:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'resources' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'numa_topology' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:40 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:40 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1486944866',display_name='tempest-ServerRescueNegativeTestJSON-server-1486944866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1486944866',id=6,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:36:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-sdeekh3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:37:00Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=40b5c2de-9cb2-4bcc-a04a-a4924e51151c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:8f:0f:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:8f:0f:83"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'pci_devices' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:38:40 user nova-compute[71500]:   <uuid>40b5c2de-9cb2-4bcc-a04a-a4924e51151c</uuid>
Apr 14 15:38:40 user nova-compute[71500]:   <name>instance-00000006</name>
Apr 14 15:38:40 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:38:40 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:38:40 user nova-compute[71500]:   <metadata>
Apr 14 15:38:40 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:38:40 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:38:40 user nova-compute[71500]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1486944866</nova:name>
Apr 14 15:38:40 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:38:40</nova:creationTime>
Apr 14 15:38:40 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:38:40 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:38:40 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:38:40 user nova-compute[71500]:       <nova:owner>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:user uuid="3fa924fefda1428d81152fd573540f26">tempest-ServerRescueNegativeTestJSON-1174024196-project-member</nova:user>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:project uuid="609ac7b149e14baab270d83a2646fbdf">tempest-ServerRescueNegativeTestJSON-1174024196</nova:project>
Apr 14 15:38:40 user nova-compute[71500]:       </nova:owner>
Apr 14 15:38:40 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:38:40 user nova-compute[71500]:       <nova:ports>
Apr 14 15:38:40 user nova-compute[71500]:         <nova:port uuid="7d184083-9af2-4aad-abc5-7d9c28804ee1">
Apr 14 15:38:40 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 15:38:40 user nova-compute[71500]:         </nova:port>
Apr 14 15:38:40 user nova-compute[71500]:       </nova:ports>
Apr 14 15:38:40 user nova-compute[71500]:     </nova:instance>
Apr 14 15:38:40 user nova-compute[71500]:   </metadata>
Apr 14 15:38:40 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:38:40 user nova-compute[71500]:     <system>
Apr 14 15:38:40 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:38:40 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:38:40 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:38:40 user nova-compute[71500]:       <entry name="serial">40b5c2de-9cb2-4bcc-a04a-a4924e51151c</entry>
Apr 14 15:38:40 user nova-compute[71500]:       <entry name="uuid">40b5c2de-9cb2-4bcc-a04a-a4924e51151c</entry>
Apr 14 15:38:40 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:38:40 user nova-compute[71500]:     </system>
Apr 14 15:38:40 user nova-compute[71500]:   </sysinfo>
Apr 14 15:38:40 user nova-compute[71500]:   <os>
Apr 14 15:38:40 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:38:40 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:38:40 user nova-compute[71500]:   </os>
Apr 14 15:38:40 user nova-compute[71500]:   <features>
Apr 14 15:38:40 user nova-compute[71500]:     <acpi/>
Apr 14 15:38:40 user nova-compute[71500]:     <apic/>
Apr 14 15:38:40 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:38:40 user nova-compute[71500]:   </features>
Apr 14 15:38:40 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:38:40 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:38:40 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:38:40 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:38:40 user nova-compute[71500]:   </clock>
Apr 14 15:38:40 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:38:40 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:38:40 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:38:40 user nova-compute[71500]:   </cpu>
Apr 14 15:38:40 user nova-compute[71500]:   <devices>
Apr 14 15:38:40 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:38:40 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:38:40 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue"/>
Apr 14 15:38:40 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:38:40 user nova-compute[71500]:     </disk>
Apr 14 15:38:40 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:38:40 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:38:40 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk"/>
Apr 14 15:38:40 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:38:40 user nova-compute[71500]:     </disk>
Apr 14 15:38:40 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:38:40 user nova-compute[71500]:       <mac address="fa:16:3e:8f:0f:83"/>
Apr 14 15:38:40 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:40 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:38:40 user nova-compute[71500]:       <target dev="tap7d184083-9a"/>
Apr 14 15:38:40 user nova-compute[71500]:     </interface>
Apr 14 15:38:40 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:38:40 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/console.log" append="off"/>
Apr 14 15:38:40 user nova-compute[71500]:     </serial>
Apr 14 15:38:40 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:38:40 user nova-compute[71500]:     <video>
Apr 14 15:38:40 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:38:40 user nova-compute[71500]:     </video>
Apr 14 15:38:40 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:38:40 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:38:40 user nova-compute[71500]:     </rng>
Apr 14 15:38:40 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:38:40 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:38:40 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:38:40 user nova-compute[71500]:     </memballoon>
Apr 14 15:38:40 user nova-compute[71500]:   </devices>
Apr 14 15:38:40 user nova-compute[71500]: </domain>
Apr 14 15:38:40 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:38:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance destroyed successfully.
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.729s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:40 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Deleted allocations for instance c66b5102-c56e-4209-afb2-c2594b271af6
Apr 14 15:38:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f75ae0c1-f4df-4cd4-a987-0e8dcb875e72 tempest-DeleteServersTestJSON-182432264 tempest-DeleteServersTestJSON-182432264-project-member] Lock "c66b5102-c56e-4209-afb2-c2594b271af6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.585s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:8f:0f:83, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:38:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 40b5c2de-9cb2-4bcc-a04a-a4924e51151c due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486724.976795, 40b5c2de-9cb2-4bcc-a04a-a4924e51151c => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:45 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] VM Resumed (Lifecycle Event)
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:45 user nova-compute[71500]: WARNING nova.compute.manager [req-c2b444b8-7be2-4789-aa8f-2e0ade77d9a5 req-4191302a-28c2-486a-80c0-09cb0ae95d50 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state active and task_state rescuing.
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:38:45 user nova-compute[71500]: WARNING nova.compute.manager [req-15bf71f0-a85d-48b7-aa93-9b2b0ac22b80 req-0a02569b-d021-478d-8406-f57e3d636619 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state active and task_state rescuing.
Apr 14 15:38:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5125c057-7f3c-4829-a2c3-78ffc11179a8 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:45 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:45 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7238MB free_disk=26.404644012451172GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3p1c7qej/c63d421b9fa443669555e47936d8d7c2.delta /opt/stack/data/nova/instances/snapshots/tmp3p1c7qej/c63d421b9fa443669555e47936d8d7c2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:45 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486724.977778, 40b5c2de-9cb2-4bcc-a04a-a4924e51151c => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:45 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] VM Started (Lifecycle Event)
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f094302b-0730-4754-b9e9-ec203312b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:38:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3p1c7qej/c63d421b9fa443669555e47936d8d7c2.delta /opt/stack/data/nova/instances/snapshots/tmp3p1c7qej/c63d421b9fa443669555e47936d8d7c2" returned: 0 in 0.337s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:38:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Snapshot extracted, beginning image upload
Apr 14 15:38:46 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:38:46 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:38:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:38:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:38:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:38:48 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Snapshot image upload complete
Apr 14 15:38:48 user nova-compute[71500]: INFO nova.compute.manager [None req-908f6cac-b350-4a23-9ae4-ce6e9688c2fb tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Took 8.95 seconds to snapshot the instance on the hypervisor.
Apr 14 15:38:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:52 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486717.2059588, c66b5102-c56e-4209-afb2-c2594b271af6 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:38:52 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] VM Stopped (Lifecycle Event)
Apr 14 15:38:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-22ee8d83-c56b-429e-b104-c250d6b58f24 None None] [instance: c66b5102-c56e-4209-afb2-c2594b271af6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:38:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:38:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-changed-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Refreshing instance network info cache due to event network-changed-674fa5df-38fc-4d44-9f38-fbae08c80e81. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Acquiring lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Acquired lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Refreshing network info cache for port 674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updated VIF entry in instance network info cache for port 674fa5df-38fc-4d44-9f38-fbae08c80e81. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updating instance_info_cache with network_info: [{"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-44b0c2c7-a3b6-477f-b1ef-295c65b4bed6 req-8c058d10-eb6a-49e1-a901-c31dc0c59b89 service nova] Releasing lock "refresh_cache-f094302b-0730-4754-b9e9-ec203312b8c0" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'flavor' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:06 user nova-compute[71500]: INFO nova.compute.manager [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Attaching volume d1689ce6-7810-4426-9055-9784f48b7e62 to /dev/vdb
Apr 14 15:39:06 user nova-compute[71500]: DEBUG os_brick.utils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f4364-f7f0-4b6d-84a8-508ab1a2a2ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3fb459-8d1b-4fb6-a414-7ad4f39265ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92057030-e4ab-4a75-bec2-3f2d031f8807]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d651cd88-193f-47ab-89cf-a5408f1345a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:06 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:39:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5adc95-56e7-43fc-b894-df902f6f6f45]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG os_brick.utils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:06 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updating existing volume attachment record: 606c95ae-ace4-4676-a67f-1c7ccdf43790 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:39:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-changed-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Refreshing instance network info cache due to event network-changed-3bdad8ab-4716-4bb3-b21e-890e392b5430. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Acquiring lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Acquired lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Refreshing network info cache for port 3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'flavor' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:09 user nova-compute[71500]: INFO nova.compute.manager [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Attaching volume b0050c51-18a0-48f3-9758-29d5adf738e1 to /dev/vdb
Apr 14 15:39:09 user nova-compute[71500]: DEBUG os_brick.utils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26338d7d-43d0-495c-a343-2ce9fd8eb3ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5d18c-7afc-4d09-abdd-d3cc438efdef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b99bc5-c619-4d95-8d99-86037c465fbf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f37e5d-32d9-470d-9c20-20aff7d3896f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updated VIF entry in instance network info cache for port 3bdad8ab-4716-4bb3-b21e-890e392b5430. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updating instance_info_cache with network_info: [{"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:10 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f9f2bf-7127-4aaf-9076-fc871e8257b1]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG os_brick.utils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updating existing volume attachment record: 652e2b30-1f1f-412c-8c34-0b32349872eb {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b4a3260-b96c-45c2-9b20-d1172d1139af req-afe44c0f-58a3-415e-a7cd-97c90442e12f service nova] Releasing lock "refresh_cache-31b57881-e95e-41d5-9f78-61d95ecfd93a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-changed-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Refreshing instance network info cache due to event network-changed-9cb5e2c1-d5d0-4325-8847-6e18b178afbf. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Acquiring lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Acquired lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Refreshing network info cache for port 9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJoxsmOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:11 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:11 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:11 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updated VIF entry in instance network info cache for port 9cb5e2c1-d5d0-4325-8847-6e18b178afbf. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updating instance_info_cache with network_info: [{"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61682d62-f74f-4d0b-8602-696067d4521b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:39:11 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca060d-0f95-4641-9f79-da2cc9c9c986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62] added
Apr 14 15:39:11 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-380971a9-fbc0-4baa-97ae-151a756aa91d req-61315659-1283-49b6-adb3-d8a4558d2a40 service nova] Releasing lock "refresh_cache-5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2f4ab6-98e0-4d57-97ba-369b850a16c0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[81980651-b9c8-46af-91d6-69aadbe9f297]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EJoxsmOr {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EJoxsmOr" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7ba08b-2361-400f-b2c4-450af2730eda]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EJoxsmOr'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d053ae86-1d9b-4bb9-bbd4-31e60df6248e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb11085-ca7c-4f5d-a55c-0db890f17c6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[099fa9b5-1056-4f08-8ffd-f9f12d505cbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260]
Apr 14 15:39:11 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:11 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c5d55-5fd7-46a3-af66-0ba59f2b5515]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b8cbcd-094e-4c64-b806-2fd238758747]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 (non-flash)
Apr 14 15:39:11 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f552481-417d-4576-b79c-cabf95f3ea30]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:39:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJoxsmOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23537666563333439', 'path': '/dev/sdh'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537666563333439', 'path': '/dev/sdh'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG nova.objects.instance [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'flavor' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:39:12 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:12 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:39:12 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:12 user nova-compute[71500]:   <serial>d1689ce6-7810-4426-9055-9784f48b7e62</serial>
Apr 14 15:39:12 user nova-compute[71500]: </disk>
Apr 14 15:39:12 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No VIF found with MAC fa:16:3e:68:eb:21, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-947f2145-7136-4bb8-b453-8c76c3a42b59 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.876s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-changed-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Refreshing instance network info cache due to event network-changed-1f6caa20-5ea5-475a-8060-25725837c3c5. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Acquiring lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Acquired lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.network.neutron [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Refreshing network info cache for port 1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.network.neutron [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updated VIF entry in instance network info cache for port 1f6caa20-5ea5-475a-8060-25725837c3c5. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.network.neutron [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-45bdd279-8501-4e31-baaa-d1c3bc7afece req-2d11ea00-2360-4bfe-8c22-a9ea3a289fdf service nova] Releasing lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "interface-112ffb8d-fef8-4ffd-991c-626c7e4c85b5-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "interface-112ffb8d-fef8-4ffd-991c-626c7e4c85b5-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.objects.instance [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'flavor' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.objects.instance [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'pci_requests' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:39:13 user nova-compute[71500]: DEBUG nova.policy [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a5a6a16abaa4c63b0220beb95fc9613', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead92c17f9e64b90adac77a44a473bde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:39:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:14 user nova-compute[71500]: INFO nova.compute.manager [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Detaching volume d1689ce6-7810-4426-9055-9784f48b7e62
Apr 14 15:39:14 user nova-compute[71500]: INFO nova.virt.block_device [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Attempting to driver detach volume d1689ce6-7810-4426-9055-9784f48b7e62 from mountpoint /dev/vdb
Apr 14 15:39:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Attempting to detach device vdb from instance f094302b-0730-4754-b9e9-ec203312b8c0 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:39:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:14 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:14 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:39:14 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:14 user nova-compute[71500]:   <serial>d1689ce6-7810-4426-9055-9784f48b7e62</serial>
Apr 14 15:39:14 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:39:14 user nova-compute[71500]: </disk>
Apr 14 15:39:14 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Successfully detached device vdb from instance f094302b-0730-4754-b9e9-ec203312b8c0 from the persistent domain config.
Apr 14 15:39:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f094302b-0730-4754-b9e9-ec203312b8c0 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:39:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:14 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:14 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:39:14 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:14 user nova-compute[71500]:   <serial>d1689ce6-7810-4426-9055-9784f48b7e62</serial>
Apr 14 15:39:14 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:39:14 user nova-compute[71500]: </disk>
Apr 14 15:39:14 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Successfully created port: 13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681486755.0214708, f094302b-0730-4754-b9e9-ec203312b8c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:39:15 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Successfully detached device vdb from instance f094302b-0730-4754-b9e9-ec203312b8c0 from the live domain config.
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EJoxsmOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:15 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dd7879-da31-401d-92a4-bed6a6018ad8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:15 user nova-compute[71500]: No targets found.
Apr 14 15:39:15 user nova-compute[71500]: iSNS:
Apr 14 15:39:15 user nova-compute[71500]: No targets found.
Apr 14 15:39:15 user nova-compute[71500]: STATIC:
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:15 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:15 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:15 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:15 user nova-compute[71500]: No targets found.
Apr 14 15:39:15 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:15 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:15 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03926de9-0e8f-4086-ae3d-036a0436c774]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfe1846-35e4-4eb3-b4b9-2f21fb6a5b29]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 (non-flash)
Apr 14 15:39:15 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc113010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62'): ({'sdh'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Removing single pathed devices sdh {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[749e860c-3c5e-451a-8725-896eed43bb9f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fef8c4a-2196-4d04-983f-5f1ea23d352f]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flushing IO for device /dev/sdh {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5079c31f-4dbf-4dd2-89e2-4fa9885cf659]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[01087610-1268-455a-862b-9de17525a8f4]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eeb9a2-6498-47ad-83be-1bb59016d6b2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Successfully updated port: 13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ca407-11ae-40de-9b63-c469951915f6]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260]
Apr 14 15:39:15 user nova-compute[71500]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:15 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquired lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-changed-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Refreshing instance network info cache due to event network-changed-13e7a077-9dd8-44e8-83d5-34706df407b6. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Acquiring lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1689ce6-7810-4426-9055-9784f48b7e62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c2a92-c53b-47b3-a32a-205c743b0f71]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] <== disconnect_volume: return (349ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Releasing lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Acquired lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.neutron [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Refreshing network info cache for port 13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG os_vif [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13e7a077-9d, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13e7a077-9d, col_values=(('external_ids', {'iface-id': '13e7a077-9dd8-44e8-83d5-34706df407b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:1e:d6', 'vm-uuid': '112ffb8d-fef8-4ffd-991c-626c7e4c85b5'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: INFO os_vif [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d')
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] attach device xml: <interface type="ethernet">
Apr 14 15:39:16 user nova-compute[71500]:   <mac address="fa:16:3e:d9:1e:d6"/>
Apr 14 15:39:16 user nova-compute[71500]:   <model type="virtio"/>
Apr 14 15:39:16 user nova-compute[71500]:   <mtu size="1442"/>
Apr 14 15:39:16 user nova-compute[71500]:   <target dev="tap13e7a077-9d"/>
Apr 14 15:39:16 user nova-compute[71500]: </interface>
Apr 14 15:39:16 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:16 user nova-compute[71500]: WARNING nova.compute.manager [req-fea6e542-c172-4cf1-bf96-f1012066a6ab req-33c7887a-5c51-4d21-b57c-81f0dd2b146d service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 for instance with vm_state active and task_state None.
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No BDM found with device name hda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No VIF found with MAC fa:16:3e:d3:0a:6d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:16 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:16 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:16 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:16</nova:creationTime>
Apr 14 15:39:16 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:16 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:16 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:16 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:16 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:16 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:16 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:16 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:16 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:16 user nova-compute[71500]:     <nova:port uuid="13e7a077-9dd8-44e8-83d5-34706df407b6">
Apr 14 15:39:16 user nova-compute[71500]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Apr 14 15:39:16 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:16 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:16 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:16 user nova-compute[71500]:  {{(pid=71500) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.objects.instance [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'flavor' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b0b487c9-40e5-4ca8-950a-c3faf7580248 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "interface-112ffb8d-fef8-4ffd-991c-626c7e4c85b5-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.969s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.neutron [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updated VIF entry in instance network info cache for port 13e7a077-9dd8-44e8-83d5-34706df407b6. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG nova.network.neutron [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4dfed35c-8f9e-4d1a-920a-fcf145860e19 req-d3e71f16-f235-48be-bd75-9c0a0514fcab service nova] Releasing lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:18 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dbb3cb-3dc8-482c-8a7d-c8baaf0d42d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:39:18 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d26190-b77a-41d7-acc0-a4d6b1777abb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1] added
Apr 14 15:39:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d09df39-6bb5-4c7f-b555-22446fc3f808]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddf33d8-1aa7-43a1-8cc5-c39ee3274a72]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:18 user nova-compute[71500]: INFO nova.compute.manager [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Attaching volume 9667742d-79e9-4d48-ba8c-b91316611c05 to /dev/sdc
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyHfrgue {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyHfrgue" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f8fc7d-3308-4895-8fbe-ab386340bf63]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xyHfrgue'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'flavor' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1393b435-30a4-4b88-8650-3b9293164af4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0984714-f0d6-4fe5-9245-e5fb460af9ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bfad7-62b4-40b8-be28-6e828b8b932d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]
Apr 14 15:39:18 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'flavor' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adcd7ed-5fbb-44c6-894f-6df930e162c2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.utils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdacc3d-cc0c-486c-bf20-fb4eec06ac06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cada75-d3ed-46cd-adea-90f7fe8e418f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f98245f9-9fe1-4b01-a585-d5b2159cd18b tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.066s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6553055d-5adf-4516-b1ca-5ec21a908ed8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d98e71-81a2-4566-b5ba-7514f76ffeea]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e5713-5ec5-4609-baa4-116430d96a81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4f1d4-4a62-472e-b7a6-d366ee176edb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:18 user nova-compute[71500]: WARNING nova.compute.manager [req-3b0043a3-9fb7-427e-a113-0286f0b08194 req-deb86de2-70bc-450c-a8f3-7bda311b48a8 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 for instance with vm_state active and task_state None.
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:18 user nova-compute[71500]: INFO nova.compute.manager [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Attaching volume e94e1b3f-9e5e-4216-88c9-f9da41093684 to /dev/vdb
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:18 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6897596c-e6a9-45aa-b3d3-024902876413]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.utils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updating existing volume attachment record: 7ba2a8a7-0821-4ab7-976c-20421aef26cd {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.utils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecf0b01-a8ec-4e4c-b18a-5db989cbee26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca099203-8226-4afd-b127-1e08976a77fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb1095-97ef-4354-bfaf-52a4c30cdbc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[903e6101-8ea6-49db-b198-fb8c61bf441a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:18 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:39:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd46800-cacc-48c9-a210-917cbd61eb71]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG os_brick.utils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:18 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating existing volume attachment record: 835cdecd-484c-46cc-a098-fbf959321bee {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26439366132346334', 'path': '/dev/sdh'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439366132346334', 'path': '/dev/sdh'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'flavor' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:39:19 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:19 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:39:19 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:19 user nova-compute[71500]:   <serial>b0050c51-18a0-48f3-9758-29d5adf738e1</serial>
Apr 14 15:39:19 user nova-compute[71500]: </disk>
Apr 14 15:39:19 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] No VIF found with MAC fa:16:3e:e2:0b:f4, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-738c9f8e-fb1b-4077-bd23-cafbb1c9549e tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.216s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG os_brick.utils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa837706-f0bf-402f-b161-a72b99119040]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b82ae0-1376-4412-a9b5-8930d50cbe0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce494b-e614-4daa-a1cd-baca019bc204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb93030-42bc-45b8-828a-86bbb2d34e93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:21 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:39:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3fc114-b6d6-4b58-b4a3-ab2c9cb4819d]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:39:21 user nova-compute[71500]: DEBUG os_brick.utils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:21 user nova-compute[71500]: INFO nova.compute.manager [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Swapping volume b0050c51-18a0-48f3-9758-29d5adf738e1 for 6acb1716-36ab-49e5-b535-81bdf883a2a1
Apr 14 15:39:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaotSXwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31b57881-e95e-41d5-9f78-61d95ecfd93a', 'attached_at': '', 'detached_at': '', 'volume_id': '6acb1716-36ab-49e5-b535-81bdf883a2a1', 'serial': '6acb1716-36ab-49e5-b535-81bdf883a2a1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '31b57881-e95e-41d5-9f78-61d95ecfd93a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0050c51-18a0-48f3-9758-29d5adf738e1', 'serial'} {{(pid=71500) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaotSXwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:25 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[00043712-c327-447a-8c10-99e3ad997027]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:39:25 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26296d0-e98b-48dc-ba1e-e925a7a94ac6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1] added
Apr 14 15:39:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ccee1-2726-4012-9f6a-2b50370ff991]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f2f67-65e6-44ef-802d-2597e57e0864]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaotSXwf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eaotSXwf" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[485fc6ad-0ceb-463e-86f5-c54518159e57]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eaotSXwf'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a885814-f45e-4c11-9257-dac8d10b5099]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0bd6da-0be5-499c-94ef-0ce908d9a067]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea68ac9-0c5c-423e-a5df-a0c8c86b6a1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260]
Apr 14 15:39:26 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJANTEkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:26 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a49331-9cdd-4177-82e1-65d0b85b2230]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c07ae6-2e8c-4a6e-ad7b-fe36ebffa808]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9429bf5-3550-42be-a851-b2d3ccc32408]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:39:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaotSXwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23165643065646266', 'path': '/dev/sdi'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165643065646266', 'path': '/dev/sdi'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.079s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:27 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:27 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG nova.objects.instance [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lazy-loading 'flavor' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6811a565-c4a5-4308-b228-3f22f69819b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:39:27 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[142bfffc-8b59-4afb-967f-8831de74d2ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05] added
Apr 14 15:39:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabc973-584a-43f6-9e64-b9b7e3b925c2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4588a6c-1276-4415-b401-8e64bc93e103]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJANTEkY {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VJANTEkY" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6722634-9da4-4c44-ad41-e66b77768e48]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VJANTEkY'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bbbbfd-05e8-4d13-b115-7890664ca024]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3abbe53-eefb-425d-8f9e-267ea9ee2b4c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[040eb361-1a78-4fb1-8048-5ed2a11a8e93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260]
Apr 14 15:39:27 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a3a439-908a-400b-8640-d1896969a505]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[daaefc90-d917-43f6-a114-b08f08d0fe77]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd16bd2c-c5b6-432d-be6a-8b31fe8287fb]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJANTEkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:39:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 7340032 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 174063616 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] <== connect_volume: return (2449ms) {'type': 'block', 'scsi_wwn': '23862373835303232', 'path': '/dev/sdj'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862373835303232', 'path': '/dev/sdj'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'flavor' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:39:28 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:28 user nova-compute[71500]:   <source dev="/dev/sdj"/>
Apr 14 15:39:28 user nova-compute[71500]:   <target dev="sdc" bus="scsi"/>
Apr 14 15:39:28 user nova-compute[71500]:   <serial>9667742d-79e9-4d48-ba8c-b91316611c05</serial>
Apr 14 15:39:28 user nova-compute[71500]:   <address type="drive" controller="0" unit="2"/>
Apr 14 15:39:28 user nova-compute[71500]: </disk>
Apr 14 15:39:28 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 321912832 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCpofRKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:28 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:28 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:28 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:39:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3456f9af-8dbe-45e7-a36b-435757b37e0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:39:28 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6a2982-9afb-4ed3-ae80-1bfcadf200f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684] added
Apr 14 15:39:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b8324-88b5-44de-a2ae-311db292f613]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65ee8d5-83fd-4685-9c22-6fbd0e00e37b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCpofRKe {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nCpofRKe" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8659b197-a0ce-4da1-80dc-61a39f7fd03d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nCpofRKe'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046a691-0677-44c8-b742-b59e1d4fb57e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No BDM found with device name sda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] No VIF found with MAC fa:16:3e:82:17:57, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddbf047-0853-4e8c-84eb-7bd9a128c906]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[186cfcd9-fb70-4d16-8516-8c7f1528e04d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260]
Apr 14 15:39:29 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b18d1b5-0cab-4250-be5f-8c83ec680275]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16cc1c59-fd73-4771-92fc-e2c49692b9d2 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.140s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[409a0ff6-ee2b-4879-b386-1a8e0b9a46d8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[804b6d96-0c81-4648-a1a1-8c59d8c8112c]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCpofRKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 616562688 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updating instance_info_cache with network_info: [{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 779091968 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] <== connect_volume: return (1487ms) {'type': 'block', 'scsi_wwn': '26263633731333533', 'path': '/dev/sdk'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263633731333533', 'path': '/dev/sdk'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'flavor' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:39:30 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:30 user nova-compute[71500]:   <source dev="/dev/sdk"/>
Apr 14 15:39:30 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:30 user nova-compute[71500]:   <serial>e94e1b3f-9e5e-4216-88c9-f9da41093684</serial>
Apr 14 15:39:30 user nova-compute[71500]: </disk>
Apr 14 15:39:30 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 952107008 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:30 user nova-compute[71500]: INFO nova.compute.manager [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Detaching volume 9667742d-79e9-4d48-ba8c-b91316611c05
Apr 14 15:39:30 user nova-compute[71500]: INFO nova.virt.block_device [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Attempting to driver detach volume 9667742d-79e9-4d48-ba8c-b91316611c05 from mountpoint /dev/sdc
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Attempting to detach device sdc from instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:30 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:30 user nova-compute[71500]:   <source dev="/dev/sdj"/>
Apr 14 15:39:30 user nova-compute[71500]:   <target dev="sdc" bus="scsi"/>
Apr 14 15:39:30 user nova-compute[71500]:   <serial>9667742d-79e9-4d48-ba8c-b91316611c05</serial>
Apr 14 15:39:30 user nova-compute[71500]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 15:39:30 user nova-compute[71500]: </disk>
Apr 14 15:39:30 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Successfully detached device sdc from instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 from the persistent domain config.
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:39:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:30 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:30 user nova-compute[71500]:   <source dev="/dev/sdj"/>
Apr 14 15:39:30 user nova-compute[71500]:   <target dev="sdc" bus="scsi"/>
Apr 14 15:39:30 user nova-compute[71500]:   <serial>9667742d-79e9-4d48-ba8c-b91316611c05</serial>
Apr 14 15:39:30 user nova-compute[71500]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 15:39:30 user nova-compute[71500]: </disk>
Apr 14 15:39:30 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No BDM found with device name hda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] No VIF found with MAC fa:16:3e:d3:0a:6d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69b621bb-8c8c-4b53-a798-fc5d0bfebbdc tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.545s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681486771.2841625, 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:39:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Successfully detached device sdc from instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 from the live domain config.
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VJANTEkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:31 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7575bdc7-f251-48aa-b210-a7228f2ea892]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:31 user nova-compute[71500]: No targets found.
Apr 14 15:39:31 user nova-compute[71500]: iSNS:
Apr 14 15:39:31 user nova-compute[71500]: No targets found.
Apr 14 15:39:31 user nova-compute[71500]: STATIC:
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:31 user nova-compute[71500]: No targets found.
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:31 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:31 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:31 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df7b4b1-490b-47f3-8f63-0c7f9be540ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fe8ead-7769-461d-add4-324cf70d34a8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf42f5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05'): ({'sdj'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Removing single pathed devices sdj {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c124b862-18d3-4c1a-8c9b-864e107d0a55]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ceaa5b-c719-43d8-9658-d976e62c4ffc]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Flushing IO for device /dev/sdj {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a61fe-43a0-4e05-a6cd-f024ac8c5207]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.036s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0831300e-ae2c-4752-886e-e7d1d1f27f15]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] SCSI volumes sdj have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[069166cf-1635-4f78-ad5d-f799866c1704]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3dc16d-c03d-4fa6-bb9f-95792328c336]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260]
Apr 14 15:39:31 user nova-compute[71500]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9667742d-79e9-4d48-ba8c-b91316611c05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd645f-8ad0-4aa9-8f0a-2531208c217b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] <== disconnect_volume: return (424ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.383s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4143e1ca-581b-4a41-99ee-f0b4c3bc961c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:31 user nova-compute[71500]: No targets found.
Apr 14 15:39:31 user nova-compute[71500]: iSNS:
Apr 14 15:39:31 user nova-compute[71500]: No targets found.
Apr 14 15:39:31 user nova-compute[71500]: STATIC:
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:31 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:31 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:31 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:31 user nova-compute[71500]: No targets found.
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:31 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:31 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b45b95-1967-4dde-ab48-9bc1a5dae9cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:31 user nova-compute[71500]: INFO nova.compute.manager [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Detaching volume e94e1b3f-9e5e-4216-88c9-f9da41093684
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f645b1-0ade-4425-8b21-53ae238394e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:31 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadfc0bf130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1'): ({'sdh'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Removing single pathed devices sdh {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb87f71-ede8-4e98-9e7b-32c67005724e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c21a9e-0d2a-4dd7-b736-a7af5e0c8630]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Flushing IO for device /dev/sdh {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: INFO nova.virt.block_device [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Attempting to driver detach volume e94e1b3f-9e5e-4216-88c9-f9da41093684 from mountpoint /dev/vdb
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4541cdac-63eb-412e-b2dc-04c6f6334b54]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Attempting to detach device vdb from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:31 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:31 user nova-compute[71500]:   <source dev="/dev/sdk"/>
Apr 14 15:39:31 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:31 user nova-compute[71500]:   <serial>e94e1b3f-9e5e-4216-88c9-f9da41093684</serial>
Apr 14 15:39:31 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 15:39:31 user nova-compute[71500]: </disk>
Apr 14 15:39:31 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully detached device vdb from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the persistent domain config.
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:31 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:31 user nova-compute[71500]:   <source dev="/dev/sdk"/>
Apr 14 15:39:31 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:31 user nova-compute[71500]:   <serial>e94e1b3f-9e5e-4216-88c9-f9da41093684</serial>
Apr 14 15:39:31 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 15:39:31 user nova-compute[71500]: </disk>
Apr 14 15:39:31 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e4a224-e8a3-41dd-b3f6-fac6c5d8d419]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e26f61-f49e-4c92-b698-bdf9ad806bf9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1739873-a125-4895-a7fa-474b2d52474b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]
Apr 14 15:39:32 user nova-compute[71500]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f55eb59-ede1-424e-993a-3168ab224fef]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] <== disconnect_volume: return (750ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaotSXwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '31b57881-e95e-41d5-9f78-61d95ecfd93a', 'attached_at': '', 'detached_at': '', 'volume_id': '6acb1716-36ab-49e5-b535-81bdf883a2a1', 'serial'} {{(pid=71500) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] swap_volume: removing Cinder connection for volume b0050c51-18a0-48f3-9758-29d5adf738e1 {{(pid=71500) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681486772.3911278, 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:39:32 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully detached device vdb from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the live domain config.
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nCpofRKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:32 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[679dbbb2-85f3-449d-9b21-16c46b66d920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:32 user nova-compute[71500]: No targets found.
Apr 14 15:39:32 user nova-compute[71500]: iSNS:
Apr 14 15:39:32 user nova-compute[71500]: No targets found.
Apr 14 15:39:32 user nova-compute[71500]: STATIC:
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:32 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:32 user nova-compute[71500]: No targets found.
Apr 14 15:39:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:32 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:32 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:32 user nova-compute[71500]: INFO nova.compute.manager [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Terminating instance
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca9d01f-298e-4eda-8c5a-90edb2a6d2f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef4c4a7-18aa-4fc0-93f1-73fab74ec254]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc113400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684'): ({'sdk'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Removing single pathed devices sdk {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8119da4a-317d-48cc-b3b6-6ac1bf127a72]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a67a2b-be7c-419e-b082-7cecbde7991b]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Flushing IO for device /dev/sdk {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ea6b30-69d5-4cee-a26a-083e95f2c422]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[79147846-f11a-4a23-b42f-7d2d21d52ff9]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] SCSI volumes sdk have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fadda8-1fdd-4dc9-896b-4443b9bbf338]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26456987-a864-472c-b2b2-311e5e3963c0]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260]
Apr 14 15:39:32 user nova-compute[71500]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-vif-unplugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] No waiting events found dispatching network-vif-unplugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-05913528-8b51-4c7a-8ce9-f6bad532a750 req-c58febdd-fb24-4987-9d61-b21489a8886f service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-vif-unplugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94e1b3f-9e5e-4216-88c9-f9da41093684 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8842a5-69a3-457b-9a76-835ca79d2a49]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] <== disconnect_volume: return (423ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:39:33 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Instance destroyed successfully.
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lazy-loading 'resources' on Instance uuid f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-130551406',display_name='tempest-VolumesActionsTest-instance-130551406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-130551406',id=10,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c377cd3ce1454ed5a6257138350802f6',ramdisk_id='',reservation_id='r-viaz4o08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1954053616',owner_user_name='tempest-VolumesActionsTest-1954053616-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data=None,user_id='426c9fdcd462435293f2208229c11458',uuid=f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Converting VIF {"id": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "address": "fa:16:3e:8d:21:bf", "network": {"id": "cc6790d7-04c1-4c9b-b432-822b3c71c178", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1478566198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "c377cd3ce1454ed5a6257138350802f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0c2ac1a-62", "ovs_interfaceid": "e0c2ac1a-629d-4583-af53-a2fa5045c311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG os_vif [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0c2ac1a-62, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:33 user nova-compute[71500]: INFO os_vif [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:21:bf,bridge_name='br-int',has_traffic_filtering=True,id=e0c2ac1a-629d-4583-af53-a2fa5045c311,network=Network(cc6790d7-04c1-4c9b-b432-822b3c71c178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0c2ac1a-62')
Apr 14 15:39:33 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Deleting instance files /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc_del
Apr 14 15:39:33 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Deletion of /opt/stack/data/nova/instances/f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc_del complete
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] swap_volume: Updating volume b0050c51-18a0-48f3-9758-29d5adf738e1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eaotSXwf", "auth_password": "j8Gclaf7bryuwP", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "6acb1716-36ab-49e5-b535-81bdf883a2a1"}, "status": "reserved", "instance": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "attached_at": "", "detached_at": "", "volume_id": "6acb1716-36ab-49e5-b535-81bdf883a2a1", "serial": "6acb1716-36ab-49e5-b535-81bdf883a2a1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6acb1716-36ab-49e5-b535-81bdf883a2a1', 'no_device': None, 'attachment_id': '6637f99b-2534-439a-9f2a-f70fa0841a6e'} {{(pid=71500) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-17181fc9-1567-4489-ab03-8edd8569e02b tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.188s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:33 user nova-compute[71500]: INFO nova.compute.manager [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Took 0.79 seconds to destroy the instance on the hypervisor.
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'flavor' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'flavor' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3e5633ad-0a22-4120-b5a7-1f0efbd228d5 tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.168s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f3daed8b-52fd-4c0c-a5b6-0dd0545592fd tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.071s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:33 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid 'f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc' (instance-0000000a)
Apr 14 15:39:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:34 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Took 0.84 seconds to deallocate network for instance.
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG os_brick.utils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c32a6a-df4c-437b-8331-ec8517c39977]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86ec36b-942a-4398-a022-91992f1ebb42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[42372f5c-b039-411a-8457-c5af4c818d74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92d2721-9490-47d0-8b84-1b652ba6df09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:39:34 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[acee0887-9966-40ea-b0d0-de4db098cc78]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG os_brick.utils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "interface-112ffb8d-fef8-4ffd-991c-626c7e4c85b5-13e7a077-9dd8-44e8-83d5-34706df407b6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "interface-112ffb8d-fef8-4ffd-991c-626c7e4c85b5-13e7a077-9dd8-44e8-83d5-34706df407b6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'flavor' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: INFO nova.compute.manager [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Swapping volume 6acb1716-36ab-49e5-b535-81bdf883a2a1 for b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface> {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface> {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Attempting to detach device tap13e7a077-9d from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] detach device xml: <interface type="ethernet">
Apr 14 15:39:34 user nova-compute[71500]:   <mac address="fa:16:3e:d9:1e:d6"/>
Apr 14 15:39:34 user nova-compute[71500]:   <model type="virtio"/>
Apr 14 15:39:34 user nova-compute[71500]:   <mtu size="1442"/>
Apr 14 15:39:34 user nova-compute[71500]:   <target dev="tap13e7a077-9d"/>
Apr 14 15:39:34 user nova-compute[71500]: </interface>
Apr 14 15:39:34 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface> {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 15:39:34 user nova-compute[71500]:   <name>instance-0000000b</name>
Apr 14 15:39:34 user nova-compute[71500]:   <uuid>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</uuid>
Apr 14 15:39:34 user nova-compute[71500]:   <metadata>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:34 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:34 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:34 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:16</nova:creationTime>
Apr 14 15:39:34 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:34 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:34 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:34 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:34 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:34 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:34 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:34 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:34 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:34 user nova-compute[71500]:     <nova:port uuid="13e7a077-9dd8-44e8-83d5-34706df407b6">
Apr 14 15:39:34 user nova-compute[71500]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Apr 14 15:39:34 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:34 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:34 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:34 user nova-compute[71500]:   </metadata>
Apr 14 15:39:34 user nova-compute[71500]:   <memory unit='KiB'>131072</memory>
Apr 14 15:39:34 user nova-compute[71500]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 15:39:34 user nova-compute[71500]:   <vcpu placement='static'>1</vcpu>
Apr 14 15:39:34 user nova-compute[71500]:   <resource>
Apr 14 15:39:34 user nova-compute[71500]:     <partition>/machine</partition>
Apr 14 15:39:34 user nova-compute[71500]:   </resource>
Apr 14 15:39:34 user nova-compute[71500]:   <sysinfo type='smbios'>
Apr 14 15:39:34 user nova-compute[71500]:     <system>
Apr 14 15:39:34 user nova-compute[71500]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 15:39:34 user nova-compute[71500]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 15:39:34 user nova-compute[71500]:       <entry name='version'>0.0.0</entry>
Apr 14 15:39:34 user nova-compute[71500]:       <entry name='serial'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:34 user nova-compute[71500]:       <entry name='uuid'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:34 user nova-compute[71500]:       <entry name='family'>Virtual Machine</entry>
Apr 14 15:39:34 user nova-compute[71500]:     </system>
Apr 14 15:39:34 user nova-compute[71500]:   </sysinfo>
Apr 14 15:39:34 user nova-compute[71500]:   <os>
Apr 14 15:39:34 user nova-compute[71500]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 15:39:34 user nova-compute[71500]:     <boot dev='hd'/>
Apr 14 15:39:34 user nova-compute[71500]:     <smbios mode='sysinfo'/>
Apr 14 15:39:34 user nova-compute[71500]:   </os>
Apr 14 15:39:34 user nova-compute[71500]:   <features>
Apr 14 15:39:34 user nova-compute[71500]:     <acpi/>
Apr 14 15:39:34 user nova-compute[71500]:     <apic/>
Apr 14 15:39:34 user nova-compute[71500]:     <vmcoreinfo state='on'/>
Apr 14 15:39:34 user nova-compute[71500]:   </features>
Apr 14 15:39:34 user nova-compute[71500]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 15:39:34 user nova-compute[71500]:     <model fallback='forbid'>Nehalem</model>
Apr 14 15:39:34 user nova-compute[71500]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 15:39:34 user nova-compute[71500]:     <feature policy='require' name='vme'/>
Apr 14 15:39:34 user nova-compute[71500]:     <feature policy='require' name='x2apic'/>
Apr 14 15:39:34 user nova-compute[71500]:     <feature policy='require' name='hypervisor'/>
Apr 14 15:39:34 user nova-compute[71500]:   </cpu>
Apr 14 15:39:34 user nova-compute[71500]:   <clock offset='utc'>
Apr 14 15:39:34 user nova-compute[71500]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 15:39:34 user nova-compute[71500]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 15:39:34 user nova-compute[71500]:     <timer name='hpet' present='no'/>
Apr 14 15:39:34 user nova-compute[71500]:   </clock>
Apr 14 15:39:34 user nova-compute[71500]:   <on_poweroff>destroy</on_poweroff>
Apr 14 15:39:34 user nova-compute[71500]:   <on_reboot>restart</on_reboot>
Apr 14 15:39:34 user nova-compute[71500]:   <on_crash>destroy</on_crash>
Apr 14 15:39:34 user nova-compute[71500]:   <devices>
Apr 14 15:39:34 user nova-compute[71500]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 15:39:34 user nova-compute[71500]:     <disk type='file' device='disk'>
Apr 14 15:39:34 user nova-compute[71500]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 15:39:34 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk' index='2'/>
Apr 14 15:39:34 user nova-compute[71500]:       <backingStore type='file' index='3'>
Apr 14 15:39:34 user nova-compute[71500]:         <format type='raw'/>
Apr 14 15:39:34 user nova-compute[71500]:         <source file='/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0'/>
Apr 14 15:39:34 user nova-compute[71500]:         <backingStore/>
Apr 14 15:39:34 user nova-compute[71500]:       </backingStore>
Apr 14 15:39:34 user nova-compute[71500]:       <target dev='vda' bus='virtio'/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='virtio-disk0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </disk>
Apr 14 15:39:34 user nova-compute[71500]:     <disk type='file' device='cdrom'>
Apr 14 15:39:34 user nova-compute[71500]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 15:39:34 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config' index='1'/>
Apr 14 15:39:34 user nova-compute[71500]:       <backingStore/>
Apr 14 15:39:34 user nova-compute[71500]:       <target dev='hda' bus='ide'/>
Apr 14 15:39:34 user nova-compute[71500]:       <readonly/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='ide0-0-0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </disk>
Apr 14 15:39:34 user nova-compute[71500]:     <controller type='usb' index='0' model='none'>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='usb'/>
Apr 14 15:39:34 user nova-compute[71500]:     </controller>
Apr 14 15:39:34 user nova-compute[71500]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='pci.0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </controller>
Apr 14 15:39:34 user nova-compute[71500]:     <controller type='ide' index='0'>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='ide'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 15:39:34 user nova-compute[71500]:     </controller>
Apr 14 15:39:34 user nova-compute[71500]:     <interface type='ethernet'>
Apr 14 15:39:34 user nova-compute[71500]:       <mac address='fa:16:3e:d3:0a:6d'/>
Apr 14 15:39:34 user nova-compute[71500]:       <target dev='tap1f6caa20-5e'/>
Apr 14 15:39:34 user nova-compute[71500]:       <model type='virtio'/>
Apr 14 15:39:34 user nova-compute[71500]:       <mtu size='1442'/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='net0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </interface>
Apr 14 15:39:34 user nova-compute[71500]:     <interface type='ethernet'>
Apr 14 15:39:34 user nova-compute[71500]:       <mac address='fa:16:3e:d9:1e:d6'/>
Apr 14 15:39:34 user nova-compute[71500]:       <target dev='tap13e7a077-9d'/>
Apr 14 15:39:34 user nova-compute[71500]:       <model type='virtio'/>
Apr 14 15:39:34 user nova-compute[71500]:       <mtu size='1442'/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='net1'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </interface>
Apr 14 15:39:34 user nova-compute[71500]:     <serial type='pty'>
Apr 14 15:39:34 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:34 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:34 user nova-compute[71500]:       <target type='isa-serial' port='0'>
Apr 14 15:39:34 user nova-compute[71500]:         <model name='isa-serial'/>
Apr 14 15:39:34 user nova-compute[71500]:       </target>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </serial>
Apr 14 15:39:34 user nova-compute[71500]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 15:39:34 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:34 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:34 user nova-compute[71500]:       <target type='serial' port='0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </console>
Apr 14 15:39:34 user nova-compute[71500]:     <input type='mouse' bus='ps2'>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='input0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </input>
Apr 14 15:39:34 user nova-compute[71500]:     <input type='keyboard' bus='ps2'>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='input1'/>
Apr 14 15:39:34 user nova-compute[71500]:     </input>
Apr 14 15:39:34 user nova-compute[71500]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 15:39:34 user nova-compute[71500]:       <listen type='address' address='0.0.0.0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </graphics>
Apr 14 15:39:34 user nova-compute[71500]:     <audio id='1' type='none'/>
Apr 14 15:39:34 user nova-compute[71500]:     <video>
Apr 14 15:39:34 user nova-compute[71500]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='video0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </video>
Apr 14 15:39:34 user nova-compute[71500]:     <memballoon model='virtio'>
Apr 14 15:39:34 user nova-compute[71500]:       <stats period='10'/>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='balloon0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </memballoon>
Apr 14 15:39:34 user nova-compute[71500]:     <rng model='virtio'>
Apr 14 15:39:34 user nova-compute[71500]:       <backend model='random'>/dev/urandom</backend>
Apr 14 15:39:34 user nova-compute[71500]:       <alias name='rng0'/>
Apr 14 15:39:34 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 15:39:34 user nova-compute[71500]:     </rng>
Apr 14 15:39:34 user nova-compute[71500]:   </devices>
Apr 14 15:39:34 user nova-compute[71500]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 15:39:34 user nova-compute[71500]:     <label>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</label>
Apr 14 15:39:34 user nova-compute[71500]:     <imagelabel>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</imagelabel>
Apr 14 15:39:34 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:34 user nova-compute[71500]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 15:39:34 user nova-compute[71500]:     <label>+64055:+108</label>
Apr 14 15:39:34 user nova-compute[71500]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 15:39:34 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:34 user nova-compute[71500]: </domain>
Apr 14 15:39:34 user nova-compute[71500]:  {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 15:39:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully detached device tap13e7a077-9d from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the persistent domain config.
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] (1/8): Attempting to detach device tap13e7a077-9d with device alias net1 from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] detach device xml: <interface type="ethernet">
Apr 14 15:39:34 user nova-compute[71500]:   <mac address="fa:16:3e:d9:1e:d6"/>
Apr 14 15:39:34 user nova-compute[71500]:   <model type="virtio"/>
Apr 14 15:39:34 user nova-compute[71500]:   <mtu size="1442"/>
Apr 14 15:39:34 user nova-compute[71500]:   <target dev="tap13e7a077-9d"/>
Apr 14 15:39:34 user nova-compute[71500]: </interface>
Apr 14 15:39:34 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:34 user nova-compute[71500]: INFO nova.compute.manager [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Terminating instance
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Acquiring lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] No waiting events found dispatching network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:34 user nova-compute[71500]: WARNING nova.compute.manager [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received unexpected event network-vif-plugged-e0c2ac1a-629d-4583-af53-a2fa5045c311 for instance with vm_state deleted and task_state None.
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-c678d0b9-1c9b-4922-abec-433a55f222f9 req-a6147ba6-8042-47e4-b4ba-2d44c29577da service nova] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Received event network-vif-deleted-e0c2ac1a-629d-4583-af53-a2fa5045c311 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:34 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.876s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681486775.0543232, 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Start waiting for the detach event from libvirt for device tap13e7a077-9d with device alias net1 for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface> {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 15:39:35 user nova-compute[71500]:   <name>instance-0000000b</name>
Apr 14 15:39:35 user nova-compute[71500]:   <uuid>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</uuid>
Apr 14 15:39:35 user nova-compute[71500]:   <metadata>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:35 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:16</nova:creationTime>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:35 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:35 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:35 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:35 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:35 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:port uuid="13e7a077-9dd8-44e8-83d5-34706df407b6">
Apr 14 15:39:35 user nova-compute[71500]:       <nova:ip type="fixed" address="10.10.10.222" ipVersion="4"/>
Apr 14 15:39:35 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:35 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:35 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:35 user nova-compute[71500]:   </metadata>
Apr 14 15:39:35 user nova-compute[71500]:   <memory unit='KiB'>131072</memory>
Apr 14 15:39:35 user nova-compute[71500]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 15:39:35 user nova-compute[71500]:   <vcpu placement='static'>1</vcpu>
Apr 14 15:39:35 user nova-compute[71500]:   <resource>
Apr 14 15:39:35 user nova-compute[71500]:     <partition>/machine</partition>
Apr 14 15:39:35 user nova-compute[71500]:   </resource>
Apr 14 15:39:35 user nova-compute[71500]:   <sysinfo type='smbios'>
Apr 14 15:39:35 user nova-compute[71500]:     <system>
Apr 14 15:39:35 user nova-compute[71500]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 15:39:35 user nova-compute[71500]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 15:39:35 user nova-compute[71500]:       <entry name='version'>0.0.0</entry>
Apr 14 15:39:35 user nova-compute[71500]:       <entry name='serial'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:35 user nova-compute[71500]:       <entry name='uuid'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:35 user nova-compute[71500]:       <entry name='family'>Virtual Machine</entry>
Apr 14 15:39:35 user nova-compute[71500]:     </system>
Apr 14 15:39:35 user nova-compute[71500]:   </sysinfo>
Apr 14 15:39:35 user nova-compute[71500]:   <os>
Apr 14 15:39:35 user nova-compute[71500]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 15:39:35 user nova-compute[71500]:     <boot dev='hd'/>
Apr 14 15:39:35 user nova-compute[71500]:     <smbios mode='sysinfo'/>
Apr 14 15:39:35 user nova-compute[71500]:   </os>
Apr 14 15:39:35 user nova-compute[71500]:   <features>
Apr 14 15:39:35 user nova-compute[71500]:     <acpi/>
Apr 14 15:39:35 user nova-compute[71500]:     <apic/>
Apr 14 15:39:35 user nova-compute[71500]:     <vmcoreinfo state='on'/>
Apr 14 15:39:35 user nova-compute[71500]:   </features>
Apr 14 15:39:35 user nova-compute[71500]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 15:39:35 user nova-compute[71500]:     <model fallback='forbid'>Nehalem</model>
Apr 14 15:39:35 user nova-compute[71500]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 15:39:35 user nova-compute[71500]:     <feature policy='require' name='vme'/>
Apr 14 15:39:35 user nova-compute[71500]:     <feature policy='require' name='x2apic'/>
Apr 14 15:39:35 user nova-compute[71500]:     <feature policy='require' name='hypervisor'/>
Apr 14 15:39:35 user nova-compute[71500]:   </cpu>
Apr 14 15:39:35 user nova-compute[71500]:   <clock offset='utc'>
Apr 14 15:39:35 user nova-compute[71500]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 15:39:35 user nova-compute[71500]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 15:39:35 user nova-compute[71500]:     <timer name='hpet' present='no'/>
Apr 14 15:39:35 user nova-compute[71500]:   </clock>
Apr 14 15:39:35 user nova-compute[71500]:   <on_poweroff>destroy</on_poweroff>
Apr 14 15:39:35 user nova-compute[71500]:   <on_reboot>restart</on_reboot>
Apr 14 15:39:35 user nova-compute[71500]:   <on_crash>destroy</on_crash>
Apr 14 15:39:35 user nova-compute[71500]:   <devices>
Apr 14 15:39:35 user nova-compute[71500]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 15:39:35 user nova-compute[71500]:     <disk type='file' device='disk'>
Apr 14 15:39:35 user nova-compute[71500]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 15:39:35 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk' index='2'/>
Apr 14 15:39:35 user nova-compute[71500]:       <backingStore type='file' index='3'>
Apr 14 15:39:35 user nova-compute[71500]:         <format type='raw'/>
Apr 14 15:39:35 user nova-compute[71500]:         <source file='/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0'/>
Apr 14 15:39:35 user nova-compute[71500]:         <backingStore/>
Apr 14 15:39:35 user nova-compute[71500]:       </backingStore>
Apr 14 15:39:35 user nova-compute[71500]:       <target dev='vda' bus='virtio'/>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='virtio-disk0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </disk>
Apr 14 15:39:35 user nova-compute[71500]:     <disk type='file' device='cdrom'>
Apr 14 15:39:35 user nova-compute[71500]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 15:39:35 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config' index='1'/>
Apr 14 15:39:35 user nova-compute[71500]:       <backingStore/>
Apr 14 15:39:35 user nova-compute[71500]:       <target dev='hda' bus='ide'/>
Apr 14 15:39:35 user nova-compute[71500]:       <readonly/>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='ide0-0-0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </disk>
Apr 14 15:39:35 user nova-compute[71500]:     <controller type='usb' index='0' model='none'>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='usb'/>
Apr 14 15:39:35 user nova-compute[71500]:     </controller>
Apr 14 15:39:35 user nova-compute[71500]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='pci.0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </controller>
Apr 14 15:39:35 user nova-compute[71500]:     <controller type='ide' index='0'>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='ide'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 15:39:35 user nova-compute[71500]:     </controller>
Apr 14 15:39:35 user nova-compute[71500]:     <interface type='ethernet'>
Apr 14 15:39:35 user nova-compute[71500]:       <mac address='fa:16:3e:d3:0a:6d'/>
Apr 14 15:39:35 user nova-compute[71500]:       <target dev='tap1f6caa20-5e'/>
Apr 14 15:39:35 user nova-compute[71500]:       <model type='virtio'/>
Apr 14 15:39:35 user nova-compute[71500]:       <mtu size='1442'/>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='net0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </interface>
Apr 14 15:39:35 user nova-compute[71500]:     <serial type='pty'>
Apr 14 15:39:35 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:35 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:35 user nova-compute[71500]:       <target type='isa-serial' port='0'>
Apr 14 15:39:35 user nova-compute[71500]:         <model name='isa-serial'/>
Apr 14 15:39:35 user nova-compute[71500]:       </target>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </serial>
Apr 14 15:39:35 user nova-compute[71500]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 15:39:35 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:35 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:35 user nova-compute[71500]:       <target type='serial' port='0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </console>
Apr 14 15:39:35 user nova-compute[71500]:     <input type='mouse' bus='ps2'>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='input0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </input>
Apr 14 15:39:35 user nova-compute[71500]:     <input type='keyboard' bus='ps2'>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='input1'/>
Apr 14 15:39:35 user nova-compute[71500]:     </input>
Apr 14 15:39:35 user nova-compute[71500]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 15:39:35 user nova-compute[71500]:       <listen type='address' address='0.0.0.0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </graphics>
Apr 14 15:39:35 user nova-compute[71500]:     <audio id='1' type='none'/>
Apr 14 15:39:35 user nova-compute[71500]:     <video>
Apr 14 15:39:35 user nova-compute[71500]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='video0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </video>
Apr 14 15:39:35 user nova-compute[71500]:     <memballoon model='virtio'>
Apr 14 15:39:35 user nova-compute[71500]:       <stats period='10'/>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='balloon0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </memballoon>
Apr 14 15:39:35 user nova-compute[71500]:     <rng model='virtio'>
Apr 14 15:39:35 user nova-compute[71500]:       <backend model='random'>/dev/urandom</backend>
Apr 14 15:39:35 user nova-compute[71500]:       <alias name='rng0'/>
Apr 14 15:39:35 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 15:39:35 user nova-compute[71500]:     </rng>
Apr 14 15:39:35 user nova-compute[71500]:   </devices>
Apr 14 15:39:35 user nova-compute[71500]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 15:39:35 user nova-compute[71500]:     <label>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</label>
Apr 14 15:39:35 user nova-compute[71500]:     <imagelabel>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</imagelabel>
Apr 14 15:39:35 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:35 user nova-compute[71500]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 15:39:35 user nova-compute[71500]:     <label>+64055:+108</label>
Apr 14 15:39:35 user nova-compute[71500]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 15:39:35 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:35 user nova-compute[71500]: </domain>
Apr 14 15:39:35 user nova-compute[71500]:  {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 15:39:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully detached device tap13e7a077-9d from instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 from the live domain config.
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG os_vif [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13e7a077-9d, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Deleted allocations for instance f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: INFO os_vif [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d')
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:35 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:35</nova:creationTime>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:35 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:35 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:35 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:35 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:35 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:35 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:35 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:35 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:35 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:35 user nova-compute[71500]:  {{(pid=71500) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-unplugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-unplugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:35 user nova-compute[71500]: WARNING nova.compute.manager [req-06e77149-d6f4-40f2-a816-1c9b2a3e154d req-1e59ec2c-16f3-4693-9b7a-bf9a4ca80c62 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-unplugged-13e7a077-9dd8-44e8-83d5-34706df407b6 for instance with vm_state active and task_state None.
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3718ad24-d150-4331-a4a3-1ab6ea6d2caf tempest-VolumesActionsTest-1954053616 tempest-VolumesActionsTest-1954053616-project-member] Lock "f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.872s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Instance destroyed successfully.
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lazy-loading 'resources' on Instance uuid 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1881974023',display_name='tempest-AttachSCSIVolumeTestJSON-server-1881974023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1881974023',id=9,image_ref='bcf08c49-d94f-43c3-882d-e1176741d8e1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAACMkTQdvaP771MHaqaa+acYdO2/wpe+WaVnIVpCxc1+9acrx0ws40PfVns7FOqGg8PvqZQBCNW1hApCelVmig7oDDClZY+ILL8blZrPBAn3T/D/58PPa2D4eUWFdfROw==',key_name='tempest-keypair-1207070274',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02da33469a7a477b876331e9b846b99a',ramdisk_id='',reservation_id='r-ut2omz01',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcf08c49-d94f-43c3-882d-e1176741d8e1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-728467558',owner_user_name='tempest-AttachSCSIVolumeTestJSON-728467558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4611274a77c4f3a8333771568ce9fbc',uuid=5cffd4a1-2cc7-4048-8902-ed914e6f0ff3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Converting VIF {"id": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "address": "fa:16:3e:82:17:57", "network": {"id": "3816a79e-94dd-4b7a-b92b-53395c339a4f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-42679330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02da33469a7a477b876331e9b846b99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb5e2c1-d5", "ovs_interfaceid": "9cb5e2c1-d5d0-4325-8847-6e18b178afbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG os_vif [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cb5e2c1-d5, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:35 user nova-compute[71500]: INFO os_vif [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:17:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb5e2c1-d5d0-4325-8847-6e18b178afbf,network=Network(3816a79e-94dd-4b7a-b92b-53395c339a4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb5e2c1-d5')
Apr 14 15:39:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Deleting instance files /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3_del
Apr 14 15:39:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Deletion of /opt/stack/data/nova/instances/5cffd4a1-2cc7-4048-8902-ed914e6f0ff3_del complete
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:35 user nova-compute[71500]: INFO nova.compute.manager [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Took 1.06 seconds to destroy the instance on the hypervisor.
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:39:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquired lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG nova.network.neutron [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-vif-unplugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] No waiting events found dispatching network-vif-unplugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-vif-unplugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Acquiring lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] No waiting events found dispatching network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:37 user nova-compute[71500]: WARNING nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received unexpected event network-vif-plugged-9cb5e2c1-d5d0-4325-8847-6e18b178afbf for instance with vm_state active and task_state deleting.
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-deleted-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:37 user nova-compute[71500]: INFO nova.compute.manager [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Neutron deleted interface 13e7a077-9dd8-44e8-83d5-34706df407b6; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.objects.instance [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lazy-loading 'system_metadata' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.objects.instance [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Lazy-loading 'flavor' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Converting VIF {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface> {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 15:39:37 user nova-compute[71500]:   <name>instance-0000000b</name>
Apr 14 15:39:37 user nova-compute[71500]:   <uuid>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</uuid>
Apr 14 15:39:37 user nova-compute[71500]:   <metadata>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:37 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:35</nova:creationTime>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:37 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:37 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:37 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:37 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:37 user nova-compute[71500]:   </metadata>
Apr 14 15:39:37 user nova-compute[71500]:   <memory unit='KiB'>131072</memory>
Apr 14 15:39:37 user nova-compute[71500]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 15:39:37 user nova-compute[71500]:   <vcpu placement='static'>1</vcpu>
Apr 14 15:39:37 user nova-compute[71500]:   <resource>
Apr 14 15:39:37 user nova-compute[71500]:     <partition>/machine</partition>
Apr 14 15:39:37 user nova-compute[71500]:   </resource>
Apr 14 15:39:37 user nova-compute[71500]:   <sysinfo type='smbios'>
Apr 14 15:39:37 user nova-compute[71500]:     <system>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='version'>0.0.0</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='serial'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='uuid'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='family'>Virtual Machine</entry>
Apr 14 15:39:37 user nova-compute[71500]:     </system>
Apr 14 15:39:37 user nova-compute[71500]:   </sysinfo>
Apr 14 15:39:37 user nova-compute[71500]:   <os>
Apr 14 15:39:37 user nova-compute[71500]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 15:39:37 user nova-compute[71500]:     <boot dev='hd'/>
Apr 14 15:39:37 user nova-compute[71500]:     <smbios mode='sysinfo'/>
Apr 14 15:39:37 user nova-compute[71500]:   </os>
Apr 14 15:39:37 user nova-compute[71500]:   <features>
Apr 14 15:39:37 user nova-compute[71500]:     <acpi/>
Apr 14 15:39:37 user nova-compute[71500]:     <apic/>
Apr 14 15:39:37 user nova-compute[71500]:     <vmcoreinfo state='on'/>
Apr 14 15:39:37 user nova-compute[71500]:   </features>
Apr 14 15:39:37 user nova-compute[71500]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 15:39:37 user nova-compute[71500]:     <model fallback='forbid'>Nehalem</model>
Apr 14 15:39:37 user nova-compute[71500]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 15:39:37 user nova-compute[71500]:     <feature policy='require' name='vme'/>
Apr 14 15:39:37 user nova-compute[71500]:     <feature policy='require' name='x2apic'/>
Apr 14 15:39:37 user nova-compute[71500]:     <feature policy='require' name='hypervisor'/>
Apr 14 15:39:37 user nova-compute[71500]:   </cpu>
Apr 14 15:39:37 user nova-compute[71500]:   <clock offset='utc'>
Apr 14 15:39:37 user nova-compute[71500]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 15:39:37 user nova-compute[71500]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 15:39:37 user nova-compute[71500]:     <timer name='hpet' present='no'/>
Apr 14 15:39:37 user nova-compute[71500]:   </clock>
Apr 14 15:39:37 user nova-compute[71500]:   <on_poweroff>destroy</on_poweroff>
Apr 14 15:39:37 user nova-compute[71500]:   <on_reboot>restart</on_reboot>
Apr 14 15:39:37 user nova-compute[71500]:   <on_crash>destroy</on_crash>
Apr 14 15:39:37 user nova-compute[71500]:   <devices>
Apr 14 15:39:37 user nova-compute[71500]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 15:39:37 user nova-compute[71500]:     <disk type='file' device='disk'>
Apr 14 15:39:37 user nova-compute[71500]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 15:39:37 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk' index='2'/>
Apr 14 15:39:37 user nova-compute[71500]:       <backingStore type='file' index='3'>
Apr 14 15:39:37 user nova-compute[71500]:         <format type='raw'/>
Apr 14 15:39:37 user nova-compute[71500]:         <source file='/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0'/>
Apr 14 15:39:37 user nova-compute[71500]:         <backingStore/>
Apr 14 15:39:37 user nova-compute[71500]:       </backingStore>
Apr 14 15:39:37 user nova-compute[71500]:       <target dev='vda' bus='virtio'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='virtio-disk0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </disk>
Apr 14 15:39:37 user nova-compute[71500]:     <disk type='file' device='cdrom'>
Apr 14 15:39:37 user nova-compute[71500]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 15:39:37 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config' index='1'/>
Apr 14 15:39:37 user nova-compute[71500]:       <backingStore/>
Apr 14 15:39:37 user nova-compute[71500]:       <target dev='hda' bus='ide'/>
Apr 14 15:39:37 user nova-compute[71500]:       <readonly/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='ide0-0-0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </disk>
Apr 14 15:39:37 user nova-compute[71500]:     <controller type='usb' index='0' model='none'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='usb'/>
Apr 14 15:39:37 user nova-compute[71500]:     </controller>
Apr 14 15:39:37 user nova-compute[71500]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='pci.0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </controller>
Apr 14 15:39:37 user nova-compute[71500]:     <controller type='ide' index='0'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='ide'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 15:39:37 user nova-compute[71500]:     </controller>
Apr 14 15:39:37 user nova-compute[71500]:     <interface type='ethernet'>
Apr 14 15:39:37 user nova-compute[71500]:       <mac address='fa:16:3e:d3:0a:6d'/>
Apr 14 15:39:37 user nova-compute[71500]:       <target dev='tap1f6caa20-5e'/>
Apr 14 15:39:37 user nova-compute[71500]:       <model type='virtio'/>
Apr 14 15:39:37 user nova-compute[71500]:       <mtu size='1442'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='net0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </interface>
Apr 14 15:39:37 user nova-compute[71500]:     <serial type='pty'>
Apr 14 15:39:37 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:37 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:37 user nova-compute[71500]:       <target type='isa-serial' port='0'>
Apr 14 15:39:37 user nova-compute[71500]:         <model name='isa-serial'/>
Apr 14 15:39:37 user nova-compute[71500]:       </target>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </serial>
Apr 14 15:39:37 user nova-compute[71500]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 15:39:37 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:37 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:37 user nova-compute[71500]:       <target type='serial' port='0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </console>
Apr 14 15:39:37 user nova-compute[71500]:     <input type='mouse' bus='ps2'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='input0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </input>
Apr 14 15:39:37 user nova-compute[71500]:     <input type='keyboard' bus='ps2'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='input1'/>
Apr 14 15:39:37 user nova-compute[71500]:     </input>
Apr 14 15:39:37 user nova-compute[71500]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 15:39:37 user nova-compute[71500]:       <listen type='address' address='0.0.0.0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </graphics>
Apr 14 15:39:37 user nova-compute[71500]:     <audio id='1' type='none'/>
Apr 14 15:39:37 user nova-compute[71500]:     <video>
Apr 14 15:39:37 user nova-compute[71500]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='video0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </video>
Apr 14 15:39:37 user nova-compute[71500]:     <memballoon model='virtio'>
Apr 14 15:39:37 user nova-compute[71500]:       <stats period='10'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='balloon0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </memballoon>
Apr 14 15:39:37 user nova-compute[71500]:     <rng model='virtio'>
Apr 14 15:39:37 user nova-compute[71500]:       <backend model='random'>/dev/urandom</backend>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='rng0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </rng>
Apr 14 15:39:37 user nova-compute[71500]:   </devices>
Apr 14 15:39:37 user nova-compute[71500]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 15:39:37 user nova-compute[71500]:     <label>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</label>
Apr 14 15:39:37 user nova-compute[71500]:     <imagelabel>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</imagelabel>
Apr 14 15:39:37 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:37 user nova-compute[71500]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 15:39:37 user nova-compute[71500]:     <label>+64055:+108</label>
Apr 14 15:39:37 user nova-compute[71500]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 15:39:37 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:37 user nova-compute[71500]: </domain>
Apr 14 15:39:37 user nova-compute[71500]:  {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface> {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d9:1e:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap13e7a077-9d"/></interface>not found in domain: <domain type='kvm' id='11'>
Apr 14 15:39:37 user nova-compute[71500]:   <name>instance-0000000b</name>
Apr 14 15:39:37 user nova-compute[71500]:   <uuid>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</uuid>
Apr 14 15:39:37 user nova-compute[71500]:   <metadata>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:37 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:35</nova:creationTime>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:37 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:37 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:37 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:37 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:37 user nova-compute[71500]:   </metadata>
Apr 14 15:39:37 user nova-compute[71500]:   <memory unit='KiB'>131072</memory>
Apr 14 15:39:37 user nova-compute[71500]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 15:39:37 user nova-compute[71500]:   <vcpu placement='static'>1</vcpu>
Apr 14 15:39:37 user nova-compute[71500]:   <resource>
Apr 14 15:39:37 user nova-compute[71500]:     <partition>/machine</partition>
Apr 14 15:39:37 user nova-compute[71500]:   </resource>
Apr 14 15:39:37 user nova-compute[71500]:   <sysinfo type='smbios'>
Apr 14 15:39:37 user nova-compute[71500]:     <system>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='version'>0.0.0</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='serial'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='uuid'>112ffb8d-fef8-4ffd-991c-626c7e4c85b5</entry>
Apr 14 15:39:37 user nova-compute[71500]:       <entry name='family'>Virtual Machine</entry>
Apr 14 15:39:37 user nova-compute[71500]:     </system>
Apr 14 15:39:37 user nova-compute[71500]:   </sysinfo>
Apr 14 15:39:37 user nova-compute[71500]:   <os>
Apr 14 15:39:37 user nova-compute[71500]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 15:39:37 user nova-compute[71500]:     <boot dev='hd'/>
Apr 14 15:39:37 user nova-compute[71500]:     <smbios mode='sysinfo'/>
Apr 14 15:39:37 user nova-compute[71500]:   </os>
Apr 14 15:39:37 user nova-compute[71500]:   <features>
Apr 14 15:39:37 user nova-compute[71500]:     <acpi/>
Apr 14 15:39:37 user nova-compute[71500]:     <apic/>
Apr 14 15:39:37 user nova-compute[71500]:     <vmcoreinfo state='on'/>
Apr 14 15:39:37 user nova-compute[71500]:   </features>
Apr 14 15:39:37 user nova-compute[71500]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 15:39:37 user nova-compute[71500]:     <model fallback='forbid'>Nehalem</model>
Apr 14 15:39:37 user nova-compute[71500]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 15:39:37 user nova-compute[71500]:     <feature policy='require' name='vme'/>
Apr 14 15:39:37 user nova-compute[71500]:     <feature policy='require' name='x2apic'/>
Apr 14 15:39:37 user nova-compute[71500]:     <feature policy='require' name='hypervisor'/>
Apr 14 15:39:37 user nova-compute[71500]:   </cpu>
Apr 14 15:39:37 user nova-compute[71500]:   <clock offset='utc'>
Apr 14 15:39:37 user nova-compute[71500]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 15:39:37 user nova-compute[71500]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 15:39:37 user nova-compute[71500]:     <timer name='hpet' present='no'/>
Apr 14 15:39:37 user nova-compute[71500]:   </clock>
Apr 14 15:39:37 user nova-compute[71500]:   <on_poweroff>destroy</on_poweroff>
Apr 14 15:39:37 user nova-compute[71500]:   <on_reboot>restart</on_reboot>
Apr 14 15:39:37 user nova-compute[71500]:   <on_crash>destroy</on_crash>
Apr 14 15:39:37 user nova-compute[71500]:   <devices>
Apr 14 15:39:37 user nova-compute[71500]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 15:39:37 user nova-compute[71500]:     <disk type='file' device='disk'>
Apr 14 15:39:37 user nova-compute[71500]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 15:39:37 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk' index='2'/>
Apr 14 15:39:37 user nova-compute[71500]:       <backingStore type='file' index='3'>
Apr 14 15:39:37 user nova-compute[71500]:         <format type='raw'/>
Apr 14 15:39:37 user nova-compute[71500]:         <source file='/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0'/>
Apr 14 15:39:37 user nova-compute[71500]:         <backingStore/>
Apr 14 15:39:37 user nova-compute[71500]:       </backingStore>
Apr 14 15:39:37 user nova-compute[71500]:       <target dev='vda' bus='virtio'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='virtio-disk0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </disk>
Apr 14 15:39:37 user nova-compute[71500]:     <disk type='file' device='cdrom'>
Apr 14 15:39:37 user nova-compute[71500]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 15:39:37 user nova-compute[71500]:       <source file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk.config' index='1'/>
Apr 14 15:39:37 user nova-compute[71500]:       <backingStore/>
Apr 14 15:39:37 user nova-compute[71500]:       <target dev='hda' bus='ide'/>
Apr 14 15:39:37 user nova-compute[71500]:       <readonly/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='ide0-0-0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </disk>
Apr 14 15:39:37 user nova-compute[71500]:     <controller type='usb' index='0' model='none'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='usb'/>
Apr 14 15:39:37 user nova-compute[71500]:     </controller>
Apr 14 15:39:37 user nova-compute[71500]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='pci.0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </controller>
Apr 14 15:39:37 user nova-compute[71500]:     <controller type='ide' index='0'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='ide'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 15:39:37 user nova-compute[71500]:     </controller>
Apr 14 15:39:37 user nova-compute[71500]:     <interface type='ethernet'>
Apr 14 15:39:37 user nova-compute[71500]:       <mac address='fa:16:3e:d3:0a:6d'/>
Apr 14 15:39:37 user nova-compute[71500]:       <target dev='tap1f6caa20-5e'/>
Apr 14 15:39:37 user nova-compute[71500]:       <model type='virtio'/>
Apr 14 15:39:37 user nova-compute[71500]:       <mtu size='1442'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='net0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </interface>
Apr 14 15:39:37 user nova-compute[71500]:     <serial type='pty'>
Apr 14 15:39:37 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:37 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:37 user nova-compute[71500]:       <target type='isa-serial' port='0'>
Apr 14 15:39:37 user nova-compute[71500]:         <model name='isa-serial'/>
Apr 14 15:39:37 user nova-compute[71500]:       </target>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </serial>
Apr 14 15:39:37 user nova-compute[71500]:     <console type='pty' tty='/dev/pts/9'>
Apr 14 15:39:37 user nova-compute[71500]:       <source path='/dev/pts/9'/>
Apr 14 15:39:37 user nova-compute[71500]:       <log file='/opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/console.log' append='off'/>
Apr 14 15:39:37 user nova-compute[71500]:       <target type='serial' port='0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='serial0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </console>
Apr 14 15:39:37 user nova-compute[71500]:     <input type='mouse' bus='ps2'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='input0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </input>
Apr 14 15:39:37 user nova-compute[71500]:     <input type='keyboard' bus='ps2'>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='input1'/>
Apr 14 15:39:37 user nova-compute[71500]:     </input>
Apr 14 15:39:37 user nova-compute[71500]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 14 15:39:37 user nova-compute[71500]:       <listen type='address' address='0.0.0.0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </graphics>
Apr 14 15:39:37 user nova-compute[71500]:     <audio id='1' type='none'/>
Apr 14 15:39:37 user nova-compute[71500]:     <video>
Apr 14 15:39:37 user nova-compute[71500]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='video0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </video>
Apr 14 15:39:37 user nova-compute[71500]:     <memballoon model='virtio'>
Apr 14 15:39:37 user nova-compute[71500]:       <stats period='10'/>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='balloon0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </memballoon>
Apr 14 15:39:37 user nova-compute[71500]:     <rng model='virtio'>
Apr 14 15:39:37 user nova-compute[71500]:       <backend model='random'>/dev/urandom</backend>
Apr 14 15:39:37 user nova-compute[71500]:       <alias name='rng0'/>
Apr 14 15:39:37 user nova-compute[71500]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 15:39:37 user nova-compute[71500]:     </rng>
Apr 14 15:39:37 user nova-compute[71500]:   </devices>
Apr 14 15:39:37 user nova-compute[71500]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 15:39:37 user nova-compute[71500]:     <label>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</label>
Apr 14 15:39:37 user nova-compute[71500]:     <imagelabel>libvirt-112ffb8d-fef8-4ffd-991c-626c7e4c85b5</imagelabel>
Apr 14 15:39:37 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:37 user nova-compute[71500]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 15:39:37 user nova-compute[71500]:     <label>+64055:+108</label>
Apr 14 15:39:37 user nova-compute[71500]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 15:39:37 user nova-compute[71500]:   </seclabel>
Apr 14 15:39:37 user nova-compute[71500]: </domain>
Apr 14 15:39:37 user nova-compute[71500]:  {{(pid=71500) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 15:39:37 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Detaching interface fa:16:3e:d9:1e:d6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap13e7a077-9d' not found.
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Converting VIF {"id": "13e7a077-9dd8-44e8-83d5-34706df407b6", "address": "fa:16:3e:d9:1e:d6", "network": {"id": "8ed402dd-b00b-4428-a6c1-e2f28034df65", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1771198172", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.222", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13e7a077-9d", "ovs_interfaceid": "13e7a077-9dd8-44e8-83d5-34706df407b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG os_vif [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13e7a077-9d, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:39:37 user nova-compute[71500]: INFO os_vif [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:1e:d6,bridge_name='br-int',has_traffic_filtering=True,id=13e7a077-9dd8-44e8-83d5-34706df407b6,network=Network(8ed402dd-b00b-4428-a6c1-e2f28034df65),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13e7a077-9d')
Apr 14 15:39:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [req-9817d2d7-a2cd-4c85-9bad-38a233f3729b req-f645367d-bb19-469b-8ebf-ffb513ff3051 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:39:37 user nova-compute[71500]:   <nova:package version="0.0.0"/>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:name>tempest-device-tagging-server-1787128288</nova:name>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:creationTime>2023-04-14 15:39:37</nova:creationTime>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:flavor name="m1.nano">
Apr 14 15:39:37 user nova-compute[71500]:     <nova:memory>128</nova:memory>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:disk>1</nova:disk>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:swap>0</nova:swap>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:vcpus>1</nova:vcpus>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:flavor>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:owner>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:user uuid="9a5a6a16abaa4c63b0220beb95fc9613">tempest-TaggedAttachmentsTest-1077829930-project-member</nova:user>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:project uuid="ead92c17f9e64b90adac77a44a473bde">tempest-TaggedAttachmentsTest-1077829930</nova:project>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:owner>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:39:37 user nova-compute[71500]:   <nova:ports>
Apr 14 15:39:37 user nova-compute[71500]:     <nova:port uuid="1f6caa20-5ea5-475a-8060-25725837c3c5">
Apr 14 15:39:37 user nova-compute[71500]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:39:37 user nova-compute[71500]:     </nova:port>
Apr 14 15:39:37 user nova-compute[71500]:   </nova:ports>
Apr 14 15:39:37 user nova-compute[71500]: </nova:instance>
Apr 14 15:39:37 user nova-compute[71500]:  {{(pid=71500) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:38 user nova-compute[71500]: WARNING nova.compute.manager [req-368ef4b2-1d28-415e-ade6-74d73a72aa58 req-aaa6522a-d20c-4895-8220-75cdc34d2e08 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-plugged-13e7a077-9dd8-44e8-83d5-34706df407b6 for instance with vm_state active and task_state None.
Apr 14 15:39:38 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:39:38 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7238MB free_disk=26.331096649169922GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:38 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Took 2.37 seconds to deallocate network for instance.
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f094302b-0730-4754-b9e9-ec203312b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:39:38 user nova-compute[71500]: INFO nova.network.neutron [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Port 13e7a077-9dd8-44e8-83d5-34706df407b6 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.network.neutron [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [{"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Releasing lock "refresh_cache-112ffb8d-fef8-4ffd-991c-626c7e4c85b5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eee65760-70da-4bd7-93a3-a2fa4bba9ef4 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "interface-112ffb8d-fef8-4ffd-991c-626c7e4c85b5-13e7a077-9dd8-44e8-83d5-34706df407b6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 4.083s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.636s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-cef580c1-6f7d-49ae-8659-e4ae53fa92f5 req-69e669de-47aa-44f1-91f8-1bb271a21a18 service nova] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Received event network-vif-deleted-9cb5e2c1-d5d0-4325-8847-6e18b178afbf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:39 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:39:39 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:39:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:39 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Deleted allocations for instance 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3
Apr 14 15:39:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d284d01e-a66a-4085-a0a6-670369c6f82e tempest-AttachSCSIVolumeTestJSON-728467558 tempest-AttachSCSIVolumeTestJSON-728467558-project-member] Lock "5cffd4a1-2cc7-4048-8902-ed914e6f0ff3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.711s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31b57881-e95e-41d5-9f78-61d95ecfd93a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0050c51-18a0-48f3-9758-29d5adf738e1', 'serial': 'b0050c51-18a0-48f3-9758-29d5adf738e1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaotSXwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '6acb1716-36ab-49e5-b535-81bdf883a2a1'}, 'status': 'reserved', 'instance': '31b57881-e95e-41d5-9f78-61d95ecfd93a', 'attached_at': '', 'detached_at': '', 'volume_id': '6acb1716-36ab-49e5-b535-81bdf883a2a1', 'serial'} {{(pid=71500) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 15:39:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:39:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:41 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:41 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:41 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:39:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4697913c-d4c2-40cb-9509-c0f8323ce29f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:39:42 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642f6b3-105d-419e-a85a-f839b3c2ac7a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1] added
Apr 14 15:39:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7327fb92-a4f7-4423-8b28-8865dd93bfe2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d54d40f-b476-4acb-bb4d-b9716c3729bd]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyHfrgue {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xyHfrgue" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d715623-5029-43d4-8062-4cac01f49934]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xyHfrgue'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0728d2-04ec-41be-a1f1-45c3719cec25]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c656e9e5-56a6-45ab-80dc-3d7f41db7f43]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0cbcb-9ae1-410a-b567-10d9ccd195d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]
Apr 14 15:39:42 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[755bb9b6-cef5-4fdb-a06c-e0b351ed2cfd]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf46b93-020c-4991-a3f0-dcc597d24251]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6deb3a-4c28-4b99-8d68-8eb2b7b2301f]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG nova.compute.manager [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-changed-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG nova.compute.manager [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing instance network info cache due to event network-changed-a5007998-31ee-4618-9fde-ab538bbd8e76. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Acquiring lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Acquired lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG nova.network.neutron [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Refreshing network info cache for port a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG nova.network.neutron [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updated VIF entry in instance network info cache for port a5007998-31ee-4618-9fde-ab538bbd8e76. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG nova.network.neutron [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b6ebf981-e0f7-4d1a-95dd-ac89552539b0 req-da55fa86-ba18-452e-8051-0148c928fcee service nova] Releasing lock "refresh_cache-f8608ac5-90b2-49e0-b037-93b5a9ed0baa" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26439366132346334', 'path': '/dev/sdh'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439366132346334', 'path': '/dev/sdh'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:39:43 user nova-compute[71500]: DEBUG nova.objects.instance [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lazy-loading 'flavor' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 110100480 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 240123904 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG nova.compute.manager [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-changed-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG nova.compute.manager [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing instance network info cache due to event network-changed-ee1af132-bea9-465f-8b76-264c96b3f02b. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Acquiring lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Acquired lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:39:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Refreshing network info cache for port ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:45 user nova-compute[71500]: INFO nova.compute.manager [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Terminating instance
Apr 14 15:39:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 412090368 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-d3277137-9fda-428e-9eb8-08940985132d req-8f9cecfc-51f6-4bfe-8b0b-2f3588c2744c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-6a76a230-e352-46c5-bec1-7d283ac41b19 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 577765376 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updated VIF entry in instance network info cache for port ee1af132-bea9-465f-8b76-264c96b3f02b. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-295ace41-ab88-42f0-9a78-d63f99270c27 req-d632bd62-9b13-49f3-9a3a-f11886837d1c service nova] Releasing lock "refresh_cache-02f5b99c-b3e0-4601-be25-1c3053d76ef2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-ee3444c8-363d-408a-bd52-5066713aaf68 req-5d0fe19d-6e1e-4a92-9b7c-aa18d5d17701 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 723517440 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-a5007998-31ee-4618-9fde-ab538bbd8e76 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.022s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: WARNING nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-a5007998-31ee-4618-9fde-ab538bbd8e76 for instance with vm_state active and task_state deleting.
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-e2de16b7-a60f-4fba-ace4-21ab648d036e for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: WARNING nova.compute.manager [req-c38ffcad-701a-451b-9203-c0027c3822c0 req-c58fdd6b-6499-4ba2-8dd0-5ca2ee5c534e service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-e2de16b7-a60f-4fba-ace4-21ab648d036e for instance with vm_state active and task_state deleting.
Apr 14 15:39:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Instance destroyed successfully.
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lazy-loading 'resources' on Instance uuid f8608ac5-90b2-49e0-b037-93b5a9ed0baa {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5007998-31, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:00:e0,bridge_name='br-int',has_traffic_filtering=True,id=a5007998-31ee-4618-9fde-ab538bbd8e76,network=Network(3d074737-eaab-4926-93e7-2dd046760ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5007998-31')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a76a230-e3, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: INFO nova.compute.manager [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Terminating instance
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:5d:1e,bridge_name='br-int',has_traffic_filtering=True,id=6a76a230-e352-46c5-bec1-7d283ac41b19,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6a76a230-e3')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 1008730112 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67aa6a19-38, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67aa6a19-38')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "a73bbd65-caef-437c-abd9-6d2ccc977830", "address": "fa:16:3e:6e:7e:f2", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73bbd65-ca", "ovs_interfaceid": "a73bbd65-caef-437c-abd9-6d2ccc977830", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73bbd65-ca, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7e:f2,bridge_name='br-int',has_traffic_filtering=True,id=a73bbd65-caef-437c-abd9-6d2ccc977830,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73bbd65-ca')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2de16b7-a6, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:8c:be,bridge_name='br-int',has_traffic_filtering=True,id=e2de16b7-a60f-4fba-ace4-21ab648d036e,network=Network(60c38bcb-c6b7-4866-89d0-04a4485005ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2de16b7-a6')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecc253cf-3d, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:4b:4a,bridge_name='br-int',has_traffic_filtering=True,id=ecc253cf-3d0b-4f54-8f5b-f3520753f121,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecc253cf-3d')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2050643769',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2050643769',id=12,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPp+kqvzeu40gpzURD+0Y92Qul+AuteZqn23LseD5UGs0yQDBzsAaxXH+tYevaNqB9z92WENbsGsUJUISPc5RN1ojd1H8o4QwNqHpFHGgybHCad8utC69kXb388UKRvtA==',key_name='tempest-keypair-1185062635',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dad6fcd223054486a97d9cbc369eff77',ramdisk_id='',reservation_id='r-1l43zxn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2101773777',owner_user_name='tempest-TaggedBootDevicesTest_v242-2101773777-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='063d123ffa4f4695bcec3583831b6097',uuid=f8608ac5-90b2-49e0-b037-93b5a9ed0baa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converting VIF {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf10a6caa-58, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: WARNING nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-6a76a230-e352-46c5-bec1-7d283ac41b19 for instance with vm_state active and task_state deleting.
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-a73bbd65-caef-437c-abd9-6d2ccc977830 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:47 user nova-compute[71500]: WARNING nova.compute.manager [req-bb53d192-1d27-4e74-8633-ec6b72323141 req-43980a74-b27b-4ff8-a724-11b64da5dae7 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-a73bbd65-caef-437c-abd9-6d2ccc977830 for instance with vm_state active and task_state deleting.
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: INFO os_vif [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0d:e1,bridge_name='br-int',has_traffic_filtering=True,id=f10a6caa-5805-4f6b-9082-7835563229c1,network=Network(c5b2412a-87f1-4ede-ad44-4a966ccbe61d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf10a6caa-58')
Apr 14 15:39:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oijOvcFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:47 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952440e-ae81-4803-bbbd-5df393f03255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]: iSNS:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]: STATIC:
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:48 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:48 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fb2539-9bd9-4911-8fff-383ef1334f3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486773.0680902, f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:39:48 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] VM Stopped (Lifecycle Event)
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e7490836-e20e-466b-9f50-a98d65a6d229 None None] [instance: f9dc5846-f51c-4fbe-a3cd-8b4096a8fedc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a960402-8892-46ff-bc24-9b0b5379b026]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae021592d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eaotSXwf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '6acb1716-36ab-49e5-b535-81bdf883a2a1': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:48 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e03c172-344c-4037-a359-dacaedc44a02]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b6689c-8510-413f-be4f-ff22285f8de3]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe764f91-ac7c-4d7d-ac0f-9d117c538b55]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7078b82-c7b3-4a23-b4f5-fa3d33f8917f]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d465e-2a28-498f-9d21-be365b42aa1b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:48 user nova-compute[71500]: WARNING nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7 for instance with vm_state active and task_state deleting.
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:48 user nova-compute[71500]: WARNING nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-ecc253cf-3d0b-4f54-8f5b-f3520753f121 for instance with vm_state active and task_state deleting.
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-unplugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-unplugged-f10a6caa-5805-4f6b-9082-7835563229c1 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] No waiting events found dispatching network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:48 user nova-compute[71500]: WARNING nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received unexpected event network-vif-plugged-f10a6caa-5805-4f6b-9082-7835563229c1 for instance with vm_state active and task_state deleting.
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-74f71090-3900-4dc9-9cd7-0a8514f7c4c8 req-4e5b96d9-1530-4d95-adc2-0aa7970c71fd service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-ee1af132-bea9-465f-8b76-264c96b3f02b for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df61c5-5abd-47b6-b29d-998156fb6c23]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260]
Apr 14 15:39:48 user nova-compute[71500]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e2cf09d-29c3-483e-b6bb-1b34da8d4b7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61399c9a-c57d-4258-b4f6-9efc44d98ecc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.446s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== disconnect_volume: return (447ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.308s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxuDUWqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:48 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22721d7-db3c-4895-a8bc-121a92762b55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]: iSNS:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]: STATIC:
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:48 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:48 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5b567-e373-463f-aa19-14bbf090640d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1a3b8d-0bd5-470d-9f35-3d47b6b0ee08]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1'): ({'sdi'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Removing single pathed devices sdi {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f391bab-622a-4e50-9aa4-48cd79294069]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b4512c-9cc2-4b3e-bcaa-66e771a85035]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Flushing IO for device /dev/sdi {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[22947f12-3f37-4399-9f69-ef854f58bbcd]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518a205-b837-4d28-ad3e-edef6a597935]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] SCSI volumes sdi have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4669d-026d-4358-98d4-d8c433c5ebe3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[027235bb-62f0-4dfe-80a2-6710a4ed05df]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260]
Apr 14 15:39:48 user nova-compute[71500]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6acb1716-36ab-49e5-b535-81bdf883a2a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8682ac2f-9165-46b9-b2fb-53b20648ddfc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] <== disconnect_volume: return (688ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.384s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ac12b-af7c-4ce4-8317-fa8a12f87b8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]: iSNS:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]: STATIC:
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5
Apr 14 15:39:48 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:48 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:48 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:48 user nova-compute[71500]: No targets found.
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:48 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:48 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f12a5f8-5d1a-43b6-9bbc-7bc5f6074af0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '31b57881-e95e-41d5-9f78-61d95ecfd93a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0050c51-18a0-48f3-9758-29d5adf738e1', 'serial'} {{(pid=71500) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] swap_volume: removing Cinder connection for volume 6acb1716-36ab-49e5-b535-81bdf883a2a1 {{(pid=71500) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[82005540-c74f-4eb5-bfbd-a0b7e9bed4fc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:48 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c933f8f8-3876-4191-bc30-67ee5a2ce632]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29dcd2-98fd-4ced-99d3-8ef935714695]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9018c53-90e0-4233-9418-c1c582c78de2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f117c61a-30f8-4a36-9eb3-729ecaa62cd7]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_60c8d277', '/dev/disk/by-id/scsi-23039313036323734', '/dev/disk/by-id/scsi-1SCST_BIO60c8d277-0910627426ec2bab') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af9e6c-714a-474f-b2cb-d7ee45140ccb]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa757147-6812-4e19-b250-113fa4a8a746]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-25141225-c1dd-4587-8056-04b3c44668c6 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:49 user nova-compute[71500]: WARNING nova.compute.manager [req-29180f99-5e3e-451c-92a1-666b41bc304d req-033d6bca-208f-4500-ace0-289fa385a85a service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-25141225-c1dd-4587-8056-04b3c44668c6 for instance with vm_state active and task_state deleting.
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac60c9-a356-4135-b5e9-bcea63584305]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260]
Apr 14 15:39:49 user nova-compute[71500]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b929b4b-4f60-46e7-8bda-cb3079ee10c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a3634-cf15-4dea-849b-fd9cf0b3533f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.491s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== disconnect_volume: return (875ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hksVMxgf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:49 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3bf8a0-6b43-467e-9fc9-73c3939762dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:49 user nova-compute[71500]: No targets found.
Apr 14 15:39:49 user nova-compute[71500]: iSNS:
Apr 14 15:39:49 user nova-compute[71500]: No targets found.
Apr 14 15:39:49 user nova-compute[71500]: STATIC:
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:49 user nova-compute[71500]: No targets found.
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:49 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:49 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Instance destroyed successfully.
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.objects.instance [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lazy-loading 'resources' on Instance uuid 02f5b99c-b3e0-4601-be25-1c3053d76ef2 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e4a96-42f6-40c7-9ced-dbcfea9c5861]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "ee1af132-bea9-465f-8b76-264c96b3f02b", "address": "fa:16:3e:08:c8:0a", "network": {"id": "a98b667f-24db-49be-b60a-2e6ed4a34a06", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-724756643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee1af132-be", "ovs_interfaceid": "ee1af132-bea9-465f-8b76-264c96b3f02b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee1af132-be, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[98799fb3-d6e7-44cc-9e9e-401fe8163502]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4111e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9'): ({'sde'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Removing single pathed devices sde {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[540f424f-544d-4052-8c74-12dcec683964]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabe74b9-09db-47a1-81d8-8f8aec4c5c85]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Flushing IO for device /dev/sde {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:c8:0a,bridge_name='br-int',has_traffic_filtering=True,id=ee1af132-bea9-465f-8b76-264c96b3f02b,network=Network(a98b667f-24db-49be-b60a-2e6ed4a34a06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee1af132-be')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4df8fbd5-68, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a65ecc9-a4e0-4d7b-bef2-3f2a625cab75]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c6:66,bridge_name='br-int',has_traffic_filtering=True,id=4df8fbd5-6858-4d05-b89b-9d3a4d9ed773,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4df8fbd5-68')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[895db43a-05dd-4a9d-b409-4283803f52a5]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1397aaf-d5, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0358e324-0002-4beb-996c-6bb922bc3f25]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7d:85,bridge_name='br-int',has_traffic_filtering=True,id=a1397aaf-d530-448a-9827-824d37cf44ba,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa1397aaf-d5')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2bc9ab1-2b, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:91:1d,bridge_name='br-int',has_traffic_filtering=True,id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2bc9ab1-2b')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6d7118-0254-4a8d-81c4-f02423ef8662]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260]
Apr 14 15:39:49 user nova-compute[71500]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6092e2c0-21, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=6092e2c0-2114-4909-aeca-bb8b43a1c220,network=Network(b300262e-c72a-4c44-90a1-f7265ed8d9dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6092e2c0-21')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e976a7ef-4ab8-4174-9a2a-c80fb2cafae9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[682bb966-202a-4a34-b71d-695ffa77f8e3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] <== disconnect_volume: return (366ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:49 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Deleting instance files /opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa_del
Apr 14 15:39:49 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Deletion of /opt/stack/data/nova/instances/f8608ac5-90b2-49e0-b037-93b5a9ed0baa_del complete
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25141225-c1, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c7:87,bridge_name='br-int',has_traffic_filtering=True,id=25141225-c1dd-4587-8056-04b3c44668c6,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25141225-c1')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1771574519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1771574519',id=13,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVzNP0ugjDR/7UkGC63txY9vxrRWCwOpU3My2lL4QS0K5IkfN4/PB1WApnPD/Q1Gj0aweWsHjRt5hxkx68CINSqtMzkutHQoiqS4TQKsog0E9HK7C3n+FeqS84zTJVgxA==',key_name='tempest-keypair-1774536726',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140cbbc3a56d44eb99f7759080f26fcb',ramdisk_id='',reservation_id='r-ghvhz7qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1487077847',owner_user_name='tempest-TaggedBootDevicesTest-1487077847-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d16729d95f2742578646f5b33dedb48b',uuid=02f5b99c-b3e0-4601-be25-1c3053d76ef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converting VIF {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7786e2f-3d, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:39:49 user nova-compute[71500]: INFO os_vif [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:bf:40,bridge_name='br-int',has_traffic_filtering=True,id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e,network=Network(575229c8-5d8a-45e4-b493-8c592f1f6a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7786e2f-3d')
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wXKCjpGd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:49 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af6cbf-6e1c-402f-bd15-530fc5e17600]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:49 user nova-compute[71500]: No targets found.
Apr 14 15:39:49 user nova-compute[71500]: iSNS:
Apr 14 15:39:49 user nova-compute[71500]: No targets found.
Apr 14 15:39:49 user nova-compute[71500]: STATIC:
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d
Apr 14 15:39:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:49 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:49 user nova-compute[71500]: No targets found.
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:49 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:49 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfb396e-53a5-48a5-91db-b401488962df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: INFO nova.compute.manager [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Took 4.59 seconds to destroy the instance on the hypervisor.
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[259a2ea3-08a4-45cb-b453-02511001e953]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf41112d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb715ee-fb77-46f6-9f4e-7a22d1f6081a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e678b4-4dbb-42e6-97e2-80fa2b24ef15]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e6a555-24f7-42b7-a67f-48ce6ee10fb6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] swap_volume: Updating volume 6acb1716-36ab-49e5-b535-81bdf883a2a1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xyHfrgue", "auth_password": "Je6FolD8r5NYLz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "b0050c51-18a0-48f3-9758-29d5adf738e1"}, "status": "reserved", "instance": "31b57881-e95e-41d5-9f78-61d95ecfd93a", "attached_at": "", "detached_at": "", "volume_id": "b0050c51-18a0-48f3-9758-29d5adf738e1", "serial": "b0050c51-18a0-48f3-9758-29d5adf738e1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b0050c51-18a0-48f3-9758-29d5adf738e1', 'no_device': None, 'attachment_id': '8f33e271-0859-443f-93e5-ba161ccfa4aa'} {{(pid=71500) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ddc447e-0da9-4753-82c9-84b5381770dc tempest-TestVolumeSwap-391043190 tempest-TestVolumeSwap-391043190-project-admin] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.742s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ed079-e292-4f62-9ba3-cd84f45b2cfd]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-4df8fbd5-6858-4d05-b89b-9d3a4d9ed773 for instance with vm_state active and task_state deleting.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-a1397aaf-d530-448a-9827-824d37cf44ba for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-a1397aaf-d530-448a-9827-824d37cf44ba for instance with vm_state active and task_state deleting.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING nova.compute.manager [req-49f85636-5794-453e-976d-45ffd1455833 req-82cca445-00a3-4726-8c3f-32dbade89087 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a for instance with vm_state active and task_state deleting.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[76496076-3f9d-4d96-9414-6a75a2cad9c4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5e4d5a-26f8-4213-8710-a6b14a097e2d]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260]
Apr 14 15:39:50 user nova-compute[71500]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:589fab96-d1de-4727-b5f3-99d4eb88c71d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e9b73-aef6-42fe-b99c-c91c0b50693b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== disconnect_volume: return (381ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zuiMNkxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61ac7cc-184e-44a8-ab7b-3f81a9c38373]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:50 user nova-compute[71500]: No targets found.
Apr 14 15:39:50 user nova-compute[71500]: iSNS:
Apr 14 15:39:50 user nova-compute[71500]: No targets found.
Apr 14 15:39:50 user nova-compute[71500]: STATIC:
Apr 14 15:39:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279
Apr 14 15:39:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:50 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:50 user nova-compute[71500]: No targets found.
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:50 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:50 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[38664574-cd2a-4901-a13e-8585836541c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a2227-e6d3-408b-96c8-dd2fa08f7c39]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae021f75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279'): ({'sdf'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Removing single pathed devices sdf {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6643e-7fe9-4af8-a61a-556009b87199]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b8579-9cc4-4478-85c1-e724d2dc3da5]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flushing IO for device /dev/sdf {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[da75e8c3-0512-42da-a7cc-4d32820ccdfb]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[003837d1-33fd-4107-8b1e-3e052856579d]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] SCSI volumes sdf have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41ae11b-350e-4935-8e8a-e49ba526c928]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-ee1af132-bea9-465f-8b76-264c96b3f02b for instance with vm_state active and task_state deleting.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-6092e2c0-2114-4909-aeca-bb8b43a1c220 for instance with vm_state active and task_state deleting.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-unplugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-unplugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Acquiring lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] No waiting events found dispatching network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING nova.compute.manager [req-a276cda8-58fe-4ff9-9c88-68106bff6e81 req-e275b165-4bb3-491b-9188-8799442336ed service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received unexpected event network-vif-plugged-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e for instance with vm_state active and task_state deleting.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[625eb2fe-c7ee-4019-bcd4-4c9b7de37c8f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260]
Apr 14 15:39:50 user nova-compute[71500]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3b561cc-fb98-4e4b-ac5a-5f62afb45279 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ebe980-29af-481a-9b6b-5b113b4310f7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== disconnect_volume: return (328ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kURHBQFn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:50 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[438711e4-84bc-406e-b3a9-88ccb5cb152c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:50 user nova-compute[71500]: No targets found.
Apr 14 15:39:50 user nova-compute[71500]: iSNS:
Apr 14 15:39:50 user nova-compute[71500]: No targets found.
Apr 14 15:39:50 user nova-compute[71500]: STATIC:
Apr 14 15:39:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11
Apr 14 15:39:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:50 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:50 user nova-compute[71500]: No targets found.
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:50 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:50 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fce3e58-9d12-4bf6-833c-806cb363d90a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[054f0b6e-f906-4dcf-82ae-1f776b38deb6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 (non-flash)
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11'): ({'sdg'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Removing single pathed devices sdg {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b551cb7-987f-46cd-af41-17d59efc9a63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[735e90ff-5f9a-4368-a9b4-4aa11daa5043]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Flushing IO for device /dev/sdg {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b85e5-6d20-4624-baed-960d083a7238]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1c60a8-bd20-46db-a74f-c13b1aa358db]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] SCSI volumes sdg have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[842815e9-9662-45c3-a2ce-7c1278906671]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486775.7094479, 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] VM Stopped (Lifecycle Event)
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-42d90ba3-b967-465f-b2c9-8af2acf9c78d None None] [instance: 5cffd4a1-2cc7-4048-8902-ed914e6f0ff3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdd7e38-dd94-4072-9daf-86288dfabeb0]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260]
Apr 14 15:39:50 user nova-compute[71500]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:890966d3-36f7-4957-82e8-fda81c2dcd11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbf3117-9176-4897-9acb-5eb237875676]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] <== disconnect_volume: return (321ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Deleting instance files /opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2_del
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Deletion of /opt/stack/data/nova/instances/02f5b99c-b3e0-4601-be25-1c3053d76ef2_del complete
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.compute.manager [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Took 3.44 seconds to destroy the instance on the hypervisor.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.compute.manager [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Detaching volume b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.virt.block_device [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Attempting to driver detach volume b0050c51-18a0-48f3-9758-29d5adf738e1 from mountpoint /dev/vdb
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Attempting to detach device vdb from instance 31b57881-e95e-41d5-9f78-61d95ecfd93a from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:50 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:50 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:39:50 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:50 user nova-compute[71500]:   <serial>b0050c51-18a0-48f3-9758-29d5adf738e1</serial>
Apr 14 15:39:50 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:39:50 user nova-compute[71500]: </disk>
Apr 14 15:39:50 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Successfully detached device vdb from instance 31b57881-e95e-41d5-9f78-61d95ecfd93a from the persistent domain config.
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31b57881-e95e-41d5-9f78-61d95ecfd93a from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:39:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:39:50 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:39:50 user nova-compute[71500]:   <source dev="/dev/sdh"/>
Apr 14 15:39:50 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:39:50 user nova-compute[71500]:   <serial>b0050c51-18a0-48f3-9758-29d5adf738e1</serial>
Apr 14 15:39:50 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:39:50 user nova-compute[71500]: </disk>
Apr 14 15:39:50 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681486791.4547782, 31b57881-e95e-41d5-9f78-61d95ecfd93a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:39:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Successfully detached device vdb from instance 31b57881-e95e-41d5-9f78-61d95ecfd93a from the live domain config.
Apr 14 15:39:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xyHfrgue', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'b0050c51-18a0-48f3-9758-29d5adf738e1': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:39:51 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c8905-6968-42a6-838a-8125c8a7f1c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:39:51 user nova-compute[71500]: No targets found.
Apr 14 15:39:51 user nova-compute[71500]: iSNS:
Apr 14 15:39:51 user nova-compute[71500]: No targets found.
Apr 14 15:39:51 user nova-compute[71500]: STATIC:
Apr 14 15:39:51 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1
Apr 14 15:39:51 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:39:51 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:39:51 user nova-compute[71500]: FIRMWARE:
Apr 14 15:39:51 user nova-compute[71500]: No targets found.
Apr 14 15:39:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:39:51 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:39:51 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f607e7-ff73-4e77-a8f7-6d21a7c01166]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b375ec52-9670-4a9b-9c3f-0a125c5304d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 (non-flash)
Apr 14 15:39:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4110790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1'): ({'sdh'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Removing single pathed devices sdh {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5817cd-f8d5-4a77-853d-744559a23408]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde3eeaf-7b69-443c-8614-cfdc5a7f471e]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Flushing IO for device /dev/sdh {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63ee2b-d317-48ff-95c4-dff528187738]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d236b8-31e5-4905-86e9-f5e41291e514]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] SCSI volumes sdh have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ada9f5-f28d-4c29-a82d-5afc2428275f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8e2224-ecba-47b6-86ef-21daa015b8cd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260]
Apr 14 15:39:51 user nova-compute[71500]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1, portal: 172.16.0.220,3260] successful.
Apr 14 15:39:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0050c51-18a0-48f3-9758-29d5adf738e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f304957-794f-4a41-879e-5c46241be4df]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] <== disconnect_volume: return (303ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:39:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:39:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-deleted-a73bbd65-caef-437c-abd9-6d2ccc977830 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:52 user nova-compute[71500]: INFO nova.compute.manager [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Neutron deleted interface a73bbd65-caef-437c-abd9-6d2ccc977830; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "address": "fa:16:3e:a7:8c:be", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2de16b7-a6", "ovs_interfaceid": "e2de16b7-a60f-4fba-ace4-21ab648d036e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-34611473-6d79-4dc4-b3c0-81416ffd397c req-937491ea-281b-46da-b70b-4b5044f45a8c service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Detach interface failed, port_id=a73bbd65-caef-437c-abd9-6d2ccc977830, reason: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'flavor' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:39:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2d0a0f18-f34a-4f8e-878b-0c4919e7ddd2 tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.963s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:39:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-deleted-e2de16b7-a60f-4fba-ace4-21ab648d036e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:54 user nova-compute[71500]: INFO nova.compute.manager [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Neutron deleted interface e2de16b7-a60f-4fba-ace4-21ab648d036e; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:54 user nova-compute[71500]: DEBUG nova.network.neutron [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f10a6caa-5805-4f6b-9082-7835563229c1", "address": "fa:16:3e:54:0d:e1", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf10a6caa-58", "ovs_interfaceid": "f10a6caa-5805-4f6b-9082-7835563229c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Detach interface failed, port_id=e2de16b7-a60f-4fba-ace4-21ab648d036e, reason: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-deleted-f10a6caa-5805-4f6b-9082-7835563229c1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:54 user nova-compute[71500]: INFO nova.compute.manager [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Neutron deleted interface f10a6caa-5805-4f6b-9082-7835563229c1; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:54 user nova-compute[71500]: DEBUG nova.network.neutron [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [{"id": "a5007998-31ee-4618-9fde-ab538bbd8e76", "address": "fa:16:3e:17:00:e0", "network": {"id": "3d074737-eaab-4926-93e7-2dd046760ec2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1868573794-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5007998-31", "ovs_interfaceid": "a5007998-31ee-4618-9fde-ab538bbd8e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a76a230-e352-46c5-bec1-7d283ac41b19", "address": "fa:16:3e:aa:5d:1e", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a76a230-e3", "ovs_interfaceid": "6a76a230-e352-46c5-bec1-7d283ac41b19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "address": "fa:16:3e:ca:b3:98", "network": {"id": "60c38bcb-c6b7-4866-89d0-04a4485005ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-1889714300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67aa6a19-38", "ovs_interfaceid": "67aa6a19-38d3-42a0-b3bc-68f70c3c3cf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "address": "fa:16:3e:5e:4b:4a", "network": {"id": "c5b2412a-87f1-4ede-ad44-4a966ccbe61d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1554893569", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dad6fcd223054486a97d9cbc369eff77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecc253cf-3d", "ovs_interfaceid": "ecc253cf-3d0b-4f54-8f5b-f3520753f121", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-abd38222-7e7f-4857-a327-fdf69da99436 req-3f409236-d828-435e-a8a7-5ef6f515d9cc service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Detach interface failed, port_id=f10a6caa-5805-4f6b-9082-7835563229c1, reason: Instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:55 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:55 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Took 5.88 seconds to deallocate network for instance.
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-deleted-ee1af132-bea9-465f-8b76-264c96b3f02b {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:56 user nova-compute[71500]: INFO nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Neutron deleted interface ee1af132-bea9-465f-8b76-264c96b3f02b; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "address": "fa:16:3e:06:91:1d", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2bc9ab1-2b", "ovs_interfaceid": "d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Detach interface failed, port_id=ee1af132-bea9-465f-8b76-264c96b3f02b, reason: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-deleted-ecc253cf-3d0b-4f54-8f5b-f3520753f121 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-deleted-d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:56 user nova-compute[71500]: INFO nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Neutron deleted interface d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "address": "fa:16:3e:e4:bf:40", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7786e2f-3d", "ovs_interfaceid": "a7786e2f-3d52-4ec4-8e66-9221db2c3e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Detach interface failed, port_id=d2bc9ab1-2b46-4f55-ae7d-fda3f320a70a, reason: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Received event network-vif-deleted-a5007998-31ee-4618-9fde-ab538bbd8e76 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-deleted-a7786e2f-3d52-4ec4-8e66-9221db2c3e3e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:56 user nova-compute[71500]: INFO nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Neutron deleted interface a7786e2f-3d52-4ec4-8e66-9221db2c3e3e; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25141225-c1dd-4587-8056-04b3c44668c6", "address": "fa:16:3e:fc:c7:87", "network": {"id": "575229c8-5d8a-45e4-b493-8c592f1f6a6b", "bridge": "br-int", "label": "tempest-device-tagging-net2-83416248", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25141225-c1", "ovs_interfaceid": "25141225-c1dd-4587-8056-04b3c44668c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Detach interface failed, port_id=a7786e2f-3d52-4ec4-8e66-9221db2c3e3e, reason: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-deleted-25141225-c1dd-4587-8056-04b3c44668c6 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:56 user nova-compute[71500]: INFO nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Neutron deleted interface 25141225-c1dd-4587-8056-04b3c44668c6; detaching it from the instance and deleting it from the info cache
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [{"id": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "address": "fa:16:3e:3b:c6:66", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4df8fbd5-68", "ovs_interfaceid": "4df8fbd5-6858-4d05-b89b-9d3a4d9ed773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a1397aaf-d530-448a-9827-824d37cf44ba", "address": "fa:16:3e:f8:7d:85", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1397aaf-d5", "ovs_interfaceid": "a1397aaf-d530-448a-9827-824d37cf44ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "address": "fa:16:3e:95:d2:5f", "network": {"id": "b300262e-c72a-4c44-90a1-f7265ed8d9dc", "bridge": "br-int", "label": "tempest-device-tagging-net1-421373938", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "140cbbc3a56d44eb99f7759080f26fcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6092e2c0-21", "ovs_interfaceid": "6092e2c0-2114-4909-aeca-bb8b43a1c220", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-2cb6688c-d421-4401-b5a4-3e427a854ca3 req-10a15ef1-00ee-4700-b155-28853482ada8 service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Detach interface failed, port_id=25141225-c1dd-4587-8056-04b3c44668c6, reason: Instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:39:56 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:39:56 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Took 5.78 seconds to deallocate network for instance.
Apr 14 15:39:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-e6beb797-7b27-461f-8ec1-8b4c6e29d474 req-8aef07f7-a5ac-4525-a4a3-adeb1e7caf6d service nova] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Received event network-vif-deleted-6092e2c0-2114-4909-aeca-bb8b43a1c220 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:39:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:39:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:02 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486787.140218, f8608ac5-90b2-49e0-b037-93b5a9ed0baa => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:02 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] VM Stopped (Lifecycle Event)
Apr 14 15:40:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-951d86b8-1806-46e5-9f02-e661a39b7f69 None None] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:03 user nova-compute[71500]: INFO nova.compute.manager [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] [instance: f8608ac5-90b2-49e0-b037-93b5a9ed0baa] Took 7.44 seconds to detach 3 volumes for instance.
Apr 14 15:40:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:03 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:03 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:03 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Deleted allocations for instance f8608ac5-90b2-49e0-b037-93b5a9ed0baa
Apr 14 15:40:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-279b3c65-f4b7-478e-b7bf-53a44b952f0d tempest-TaggedBootDevicesTest_v242-2101773777 tempest-TaggedBootDevicesTest_v242-2101773777-project-member] Lock "f8608ac5-90b2-49e0-b037-93b5a9ed0baa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 18.493s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:03 user nova-compute[71500]: INFO nova.compute.manager [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Took 7.32 seconds to detach 3 volumes for instance.
Apr 14 15:40:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:04 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:04 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Deleted allocations for instance 02f5b99c-b3e0-4601-be25-1c3053d76ef2
Apr 14 15:40:04 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486789.367733, 02f5b99c-b3e0-4601-be25-1c3053d76ef2 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:04 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] VM Stopped (Lifecycle Event)
Apr 14 15:40:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-91cd662f-85d4-4d9a-8aa2-c64c5ce5210a None None] [instance: 02f5b99c-b3e0-4601-be25-1c3053d76ef2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a24950cf-d688-49fa-ab0a-648e83a359f1 tempest-TaggedBootDevicesTest-1487077847 tempest-TaggedBootDevicesTest-1487077847-project-member] Lock "02f5b99c-b3e0-4601-be25-1c3053d76ef2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.030s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:40:06 user nova-compute[71500]: INFO nova.compute.claims [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Claim successful on node user
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:40:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.policy [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1aa921f86bd4f3b88eb782d5f667816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '029b8c395f264a86933a9e878c18e0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:40:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Creating image(s)
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "/opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "/opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "/opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk 1073741824" returned: 0 in 0.048s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Cannot resize image /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'migration_context' on Instance uuid 19de875a-a784-46f6-8c6e-f2fad198ba32 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Ensure instance console log exists: /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:07 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Successfully created port: 12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Successfully updated port: 12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "refresh_cache-19de875a-a784-46f6-8c6e-f2fad198ba32" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquired lock "refresh_cache-19de875a-a784-46f6-8c6e-f2fad198ba32" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-changed-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Refreshing instance network info cache due to event network-changed-12f4faa8-1f30-4403-9114-14195ee6d862. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Acquiring lock "refresh_cache-19de875a-a784-46f6-8c6e-f2fad198ba32" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Updating instance_info_cache with network_info: [{"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Releasing lock "refresh_cache-19de875a-a784-46f6-8c6e-f2fad198ba32" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Instance network_info: |[{"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Acquired lock "refresh_cache-19de875a-a784-46f6-8c6e-f2fad198ba32" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.neutron [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Refreshing network info cache for port 12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Start _get_guest_xml network_info=[{"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:40:08 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:08 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1429675285',display_name='tempest-VolumesAdminNegativeTest-server-1429675285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1429675285',id=15,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='029b8c395f264a86933a9e878c18e0b2',ramdisk_id='',reservation_id='r-mf71yp7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1127532',owner_user_name='tempest-VolumesAdminNegativeTest-1127532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:07Z,user_data=None,user_id='e1aa921f86bd4f3b88eb782d5f667816',uuid=19de875a-a784-46f6-8c6e-f2fad198ba32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converting VIF {"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'pci_devices' on Instance uuid 19de875a-a784-46f6-8c6e-f2fad198ba32 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:40:08 user nova-compute[71500]:   <uuid>19de875a-a784-46f6-8c6e-f2fad198ba32</uuid>
Apr 14 15:40:08 user nova-compute[71500]:   <name>instance-0000000f</name>
Apr 14 15:40:08 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:40:08 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:40:08 user nova-compute[71500]:   <metadata>
Apr 14 15:40:08 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:40:08 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:40:08 user nova-compute[71500]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1429675285</nova:name>
Apr 14 15:40:08 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:40:08</nova:creationTime>
Apr 14 15:40:08 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:40:08 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:40:08 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:40:08 user nova-compute[71500]:       <nova:owner>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:user uuid="e1aa921f86bd4f3b88eb782d5f667816">tempest-VolumesAdminNegativeTest-1127532-project-member</nova:user>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:project uuid="029b8c395f264a86933a9e878c18e0b2">tempest-VolumesAdminNegativeTest-1127532</nova:project>
Apr 14 15:40:08 user nova-compute[71500]:       </nova:owner>
Apr 14 15:40:08 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:40:08 user nova-compute[71500]:       <nova:ports>
Apr 14 15:40:08 user nova-compute[71500]:         <nova:port uuid="12f4faa8-1f30-4403-9114-14195ee6d862">
Apr 14 15:40:08 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 15:40:08 user nova-compute[71500]:         </nova:port>
Apr 14 15:40:08 user nova-compute[71500]:       </nova:ports>
Apr 14 15:40:08 user nova-compute[71500]:     </nova:instance>
Apr 14 15:40:08 user nova-compute[71500]:   </metadata>
Apr 14 15:40:08 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:40:08 user nova-compute[71500]:     <system>
Apr 14 15:40:08 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:40:08 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:40:08 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:40:08 user nova-compute[71500]:       <entry name="serial">19de875a-a784-46f6-8c6e-f2fad198ba32</entry>
Apr 14 15:40:08 user nova-compute[71500]:       <entry name="uuid">19de875a-a784-46f6-8c6e-f2fad198ba32</entry>
Apr 14 15:40:08 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:40:08 user nova-compute[71500]:     </system>
Apr 14 15:40:08 user nova-compute[71500]:   </sysinfo>
Apr 14 15:40:08 user nova-compute[71500]:   <os>
Apr 14 15:40:08 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:40:08 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:40:08 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:40:08 user nova-compute[71500]:   </os>
Apr 14 15:40:08 user nova-compute[71500]:   <features>
Apr 14 15:40:08 user nova-compute[71500]:     <acpi/>
Apr 14 15:40:08 user nova-compute[71500]:     <apic/>
Apr 14 15:40:08 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:40:08 user nova-compute[71500]:   </features>
Apr 14 15:40:08 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:40:08 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:40:08 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:40:08 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:40:08 user nova-compute[71500]:   </clock>
Apr 14 15:40:08 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:40:08 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:40:08 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:40:08 user nova-compute[71500]:   </cpu>
Apr 14 15:40:08 user nova-compute[71500]:   <devices>
Apr 14 15:40:08 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:40:08 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:40:08 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk"/>
Apr 14 15:40:08 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:40:08 user nova-compute[71500]:     </disk>
Apr 14 15:40:08 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:40:08 user nova-compute[71500]:       <mac address="fa:16:3e:19:0a:4f"/>
Apr 14 15:40:08 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:08 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:40:08 user nova-compute[71500]:       <target dev="tap12f4faa8-1f"/>
Apr 14 15:40:08 user nova-compute[71500]:     </interface>
Apr 14 15:40:08 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:40:08 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/console.log" append="off"/>
Apr 14 15:40:08 user nova-compute[71500]:     </serial>
Apr 14 15:40:08 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:40:08 user nova-compute[71500]:     <video>
Apr 14 15:40:08 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:08 user nova-compute[71500]:     </video>
Apr 14 15:40:08 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:40:08 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:40:08 user nova-compute[71500]:     </rng>
Apr 14 15:40:08 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:40:08 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:40:08 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:40:08 user nova-compute[71500]:     </memballoon>
Apr 14 15:40:08 user nova-compute[71500]:   </devices>
Apr 14 15:40:08 user nova-compute[71500]: </domain>
Apr 14 15:40:08 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1429675285',display_name='tempest-VolumesAdminNegativeTest-server-1429675285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1429675285',id=15,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='029b8c395f264a86933a9e878c18e0b2',ramdisk_id='',reservation_id='r-mf71yp7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1127532',owner_user_name='tempest-VolumesAdminNegativeTest-1127532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:07Z,user_data=None,user_id='e1aa921f86bd4f3b88eb782d5f667816',uuid=19de875a-a784-46f6-8c6e-f2fad198ba32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converting VIF {"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG os_vif [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12f4faa8-1f, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12f4faa8-1f, col_values=(('external_ids', {'iface-id': '12f4faa8-1f30-4403-9114-14195ee6d862', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:0a:4f', 'vm-uuid': '19de875a-a784-46f6-8c6e-f2fad198ba32'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:40:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:08 user nova-compute[71500]: INFO os_vif [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f')
Apr 14 15:40:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] No VIF found with MAC fa:16:3e:19:0a:4f, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:40:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Updated VIF entry in instance network info cache for port 12f4faa8-1f30-4403-9114-14195ee6d862. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:40:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Updating instance_info_cache with network_info: [{"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2fde3802-f0cc-4255-82ea-175f0b84aa0e req-0e4550c5-7fcd-4acc-9948-22060f50f578 service nova] Releasing lock "refresh_cache-19de875a-a784-46f6-8c6e-f2fad198ba32" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] No waiting events found dispatching network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:10 user nova-compute[71500]: WARNING nova.compute.manager [req-20fd435f-a0cc-4fd9-86d5-c6b10d6bfbd8 req-f27ec1f9-4c3b-4555-b622-08acebe3af48 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received unexpected event network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 for instance with vm_state building and task_state spawning.
Apr 14 15:40:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486812.6296937, 19de875a-a784-46f6-8c6e-f2fad198ba32 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] VM Resumed (Lifecycle Event)
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Instance spawned successfully.
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] No waiting events found dispatching network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:12 user nova-compute[71500]: WARNING nova.compute.manager [req-16c26236-2526-4375-b520-e3d62ec6d5e4 req-571ab6cd-ed7a-4774-bf84-1dba9f539f37 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received unexpected event network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 for instance with vm_state building and task_state spawning.
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486812.6353931, 19de875a-a784-46f6-8c6e-f2fad198ba32 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] VM Started (Lifecycle Event)
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Took 6.14 seconds to spawn the instance on the hypervisor.
Apr 14 15:40:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:12 user nova-compute[71500]: INFO nova.compute.manager [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Took 6.87 seconds to build instance.
Apr 14 15:40:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6bdc3870-9b56-4353-9941-2e8216b6334a tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.966s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:15 user nova-compute[71500]: INFO nova.compute.manager [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Terminating instance
Apr 14 15:40:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-unplugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] No waiting events found dispatching network-vif-unplugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-47bf2418-3282-4580-a929-92d30d1600dc req-6006cd8e-6e6c-4d83-a3d6-8d5d65409474 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-unplugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Instance destroyed successfully.
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.objects.instance [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lazy-loading 'resources' on Instance uuid f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1018319414',display_name='tempest-ServersNegativeTestJSON-server-1018319414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1018319414',id=14,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a8e73ef2ad94e84876def53ddf43da4',ramdisk_id='',reservation_id='r-vsgzs8mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-443911091',owner_user_name='tempest-ServersNegativeTestJSON-443911091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:37Z,user_data=None,user_id='af824b840c604223afd90bce17fe1ceb',uuid=f5f1e2d0-08c5-4f11-b90a-7257a14e4e62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converting VIF {"id": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "address": "fa:16:3e:b3:37:43", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a5e9f47-a6", "ovs_interfaceid": "2a5e9f47-a62f-4feb-be9c-2a4bc943c378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG os_vif [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a5e9f47-a6, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:40:16 user nova-compute[71500]: INFO os_vif [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:37:43,bridge_name='br-int',has_traffic_filtering=True,id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a5e9f47-a6')
Apr 14 15:40:16 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Deleting instance files /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62_del
Apr 14 15:40:16 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Deletion of /opt/stack/data/nova/instances/f5f1e2d0-08c5-4f11-b90a-7257a14e4e62_del complete
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: INFO nova.compute.manager [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 15:40:16 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:17 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Took 0.74 seconds to deallocate network for instance.
Apr 14 15:40:17 user nova-compute[71500]: DEBUG nova.compute.manager [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-deleted-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:17 user nova-compute[71500]: INFO nova.compute.manager [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Neutron deleted interface 2a5e9f47-a62f-4feb-be9c-2a4bc943c378; detaching it from the instance and deleting it from the info cache
Apr 14 15:40:17 user nova-compute[71500]: DEBUG nova.network.neutron [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG nova.compute.manager [req-3a3dc569-5e42-4ed7-8b9e-ca21fb399798 req-955d0c4c-71da-4d4b-9dba-e164ea9f2883 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Detach interface failed, port_id=2a5e9f47-a62f-4feb-be9c-2a4bc943c378, reason: Instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:17 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Deleted allocations for instance f5f1e2d0-08c5-4f11-b90a-7257a14e4e62
Apr 14 15:40:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-577e906d-f30c-4207-a9b1-6e5a1466ae2d tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] No waiting events found dispatching network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:18 user nova-compute[71500]: WARNING nova.compute.manager [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received unexpected event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance with vm_state deleted and task_state None.
Apr 14 15:40:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Acquiring lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] Lock "f5f1e2d0-08c5-4f11-b90a-7257a14e4e62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] No waiting events found dispatching network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:18 user nova-compute[71500]: WARNING nova.compute.manager [req-b1145c78-b369-49b7-ba7e-3bf7e90713bc req-f44bb565-18fc-4101-ac22-1064763220e6 service nova] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Received unexpected event network-vif-plugged-2a5e9f47-a62f-4feb-be9c-2a4bc943c378 for instance with vm_state deleted and task_state None.
Apr 14 15:40:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:25 user nova-compute[71500]: INFO nova.compute.manager [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Terminating instance
Apr 14 15:40:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-unplugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-unplugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b917cf4-b152-453b-8c3f-c3ae911940bd req-c975c0a7-6ffb-429f-92fd-d9f4073b1022 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-unplugged-1f6caa20-5ea5-475a-8060-25725837c3c5 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:40:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Instance destroyed successfully.
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.objects.instance [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lazy-loading 'resources' on Instance uuid 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T15:37:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787128288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787128288',id=11,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5RqNKyf3EcPCxOaPrOsJ1s4hAWPmt82z8J8sQ7woV0DMNzn8JiQxsFypnbqGGF9uoHXaZHLMdUkLgjPxwO+kYWK7nGbxMSuBBVNULFkVDK4VATwZsj3BsXkzww+sDdcg==',key_name='tempest-keypair-1198337819',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ead92c17f9e64b90adac77a44a473bde',ramdisk_id='',reservation_id='r-9chv07o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1077829930',owner_user_name='tempest-TaggedAttachmentsTest-1077829930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a5a6a16abaa4c63b0220beb95fc9613',uuid=112ffb8d-fef8-4ffd-991c-626c7e4c85b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converting VIF {"id": "1f6caa20-5ea5-475a-8060-25725837c3c5", "address": "fa:16:3e:d3:0a:6d", "network": {"id": "af630e01-6220-4496-8c7b-659dc25d39a2", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-555071865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ead92c17f9e64b90adac77a44a473bde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f6caa20-5e", "ovs_interfaceid": "1f6caa20-5ea5-475a-8060-25725837c3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG os_vif [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f6caa20-5e, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:40:26 user nova-compute[71500]: INFO os_vif [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:0a:6d,bridge_name='br-int',has_traffic_filtering=True,id=1f6caa20-5ea5-475a-8060-25725837c3c5,network=Network(af630e01-6220-4496-8c7b-659dc25d39a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f6caa20-5e')
Apr 14 15:40:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Deleting instance files /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5_del
Apr 14 15:40:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Deletion of /opt/stack/data/nova/instances/112ffb8d-fef8-4ffd-991c-626c7e4c85b5_del complete
Apr 14 15:40:26 user nova-compute[71500]: INFO nova.compute.manager [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:26 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:40:26 user nova-compute[71500]: INFO nova.compute.claims [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Claim successful on node user
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:40:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:40:27 user nova-compute[71500]: INFO nova.virt.block_device [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Booting with blank volume at /dev/vda
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.policy [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:27 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Took 1.04 seconds to deallocate network for instance.
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-deleted-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:27 user nova-compute[71500]: INFO nova.compute.manager [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Neutron deleted interface 1f6caa20-5ea5-475a-8060-25725837c3c5; detaching it from the instance and deleting it from the info cache
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.network.neutron [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-32a09202-0497-4c74-9d09-ea86f3049f16 req-1d865c91-2a84-43f4-a711-b5662015e174 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Detach interface failed, port_id=1f6caa20-5ea5-475a-8060-25725837c3c5, reason: Instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:27 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Deleted allocations for instance 112ffb8d-fef8-4ffd-991c-626c7e4c85b5
Apr 14 15:40:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-69680783-4f19-4b39-bf58-b2fb03b15048 tempest-TaggedAttachmentsTest-1077829930 tempest-TaggedAttachmentsTest-1077829930-project-member] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.601s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received event network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Acquiring lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] Lock "112ffb8d-fef8-4ffd-991c-626c7e4c85b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] No waiting events found dispatching network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:28 user nova-compute[71500]: WARNING nova.compute.manager [req-c88a6d14-e7ca-4cfd-a3c5-bd58a5906645 req-4a1d1109-9409-4ae0-bd55-7535056dd928 service nova] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Received unexpected event network-vif-plugged-1f6caa20-5ea5-475a-8060-25725837c3c5 for instance with vm_state deleted and task_state None.
Apr 14 15:40:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Successfully created port: 18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:40:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Successfully updated port: 18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-changed-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Refreshing instance network info cache due to event network-changed-18973ac2-c226-4d12-98e7-5bbee348527a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Acquiring lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance network_info: |[{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Acquired lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:29 user nova-compute[71500]: DEBUG nova.network.neutron [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Refreshing network info cache for port 18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:40:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updated VIF entry in instance network info cache for port 18973ac2-c226-4d12-98e7-5bbee348527a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:40:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1468bc68-87ab-4d32-8ae8-3eec47321229 req-9aae90a2-97e3-46aa-85dc-e98320799b81 service nova] Releasing lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:31 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486816.4611013, f5f1e2d0-08c5-4f11-b90a-7257a14e4e62 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:31 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] VM Stopped (Lifecycle Event)
Apr 14 15:40:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8ef2044e-b840-4cc1-a614-1e8d7d18fc93 None None] [instance: f5f1e2d0-08c5-4f11-b90a-7257a14e4e62] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.utils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c029897b-f4ee-4da4-8352-708f519932c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2239132-e9ed-48d6-93a2-996810ccffc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae9fd70-5975-46e6-916a-a2d90b9b2db9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a88cf0-76ee-4380-a79b-9bdab0de056f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:40:33 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[408dc03c-cbbb-4aa2-81e8-600801509e8f]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.utils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating existing volume attachment record: 479707a0-97b2-47e8-adb0-c9566985bfbc {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'flavor' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:33 user nova-compute[71500]: INFO nova.compute.manager [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Attaching volume 2f60c4f2-a281-469b-9c0e-cf96631f965c to /dev/vdb
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.utils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d3efca-1161-409c-986b-b76c71e9a12a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c1e521-f0ff-4347-8856-7de57ca354ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcffcf11-79af-4baf-b64a-66b4d748423e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[526d2a02-e205-49c7-8a7c-c103647cd85a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:40:33 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0286afa-44bf-43c7-95d5-a2ccabf35655]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG os_brick.utils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating existing volume attachment record: 254876ae-f7a8-4156-acff-2783ff15c0a6 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:40:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApwjImHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:40:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:40:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:40:39 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:40:39 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:39 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=26.397159576416016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b6dfaa-e92f-4aa8-be7a-a122c0c08786]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:40:39 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa5e266-9a5a-4005-829b-fc64719a8484]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c] added
Apr 14 15:40:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d44f0-18ce-4cbd-990a-773b4be9e93d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cdb0dd-8afc-4418-9451-08e7ac698d9a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApwjImHT {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApwjImHT" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c490fbec-1f4b-4ce6-a820-3fd41b161a33]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ApwjImHT'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[16670078-45f9-4c70-9593-031df9faba0f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f094302b-0730-4754-b9e9-ec203312b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b68bfe-a0cf-45ad-a1ae-7d7373a2aa95]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:40:39 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:40:39 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:40:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 15:40:39 user nova-compute[71500]: 
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:40:39 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Creating image(s)
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Ensure instance console log exists: /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Start _get_guest_xml network_info=[{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '479707a0-97b2-47e8-adb0-c9566985bfbc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3', 'attached_at': '', 'detached_at': '', 'volume_id': '34a8d836-37e0-4250-9c77-0bec8d481ee4', 'serial': '34a8d836-37e0-4250-9c77-0bec8d481ee4'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:40:39 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:39 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:40:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[af63c934-8a0c-40d7-a268-e00b27ff459f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260]
Apr 14 15:40:39 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260] successful.
Apr 14 15:40:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e51656-0008-4be9-8d59-cc1bd5e3592f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2d598-5b85-4f2e-bb18-cc93e03ac048]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[74425deb-0f63-4941-a74a-b75e6ca79eee]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:40:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApwjImHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '26662376661623630', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662376661623630', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.082s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:40:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:40:40 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'flavor' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c025875-7e84-458e-8873-f4d0fa051043]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:40:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:40:40 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:40:40 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:40:40 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:40:40 user nova-compute[71500]:   <serial>2f60c4f2-a281-469b-9c0e-cf96631f965c</serial>
Apr 14 15:40:40 user nova-compute[71500]: </disk>
Apr 14 15:40:40 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[604bf574-edec-4cf1-bbdb-2038ab4c30d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4] added
Apr 14 15:40:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a401f64e-03d4-44e3-b235-58626fb355f4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[604c3501-b4ee-4be9-82b3-8b238b562b56]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEOCaKTZ {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEOCaKTZ" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d8fa76-ab2d-4fb4-9814-d447e1fbbd2a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bEOCaKTZ'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a9946-e3e8-4f4d-a34f-0c259532957e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cde0b4-800e-46a8-83ce-d2201bb32909]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c288f03a-e3dc-4638-9e3c-823df20b9d33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260]
Apr 14 15:40:40 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260] successful.
Apr 14 15:40:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361f407-cf1b-4a15-9270-1bd0ddab4cb3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a45df-f067-4540-9a25-b483a59107cb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:40 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:40:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:40 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:40:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:40:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c92ce0-a8fe-4725-aed0-c9373aa4cb30]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No VIF found with MAC fa:16:3e:2c:45:27, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Terminating instance
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486826.3339293, 112ffb8d-fef8-4ffd-991c-626c7e4c85b5 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:41 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] VM Stopped (Lifecycle Event)
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1c7a0619-ea84-46bd-9555-30a278ae6ae3 None None] [instance: 112ffb8d-fef8-4ffd-991c-626c7e4c85b5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6873bf66-d1cf-4362-a300-e6bb28fc899d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.029s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-vif-unplugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] No waiting events found dispatching network-vif-unplugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-19888352-b4af-4b53-a6e2-b1cafd1bfff6 req-8742f8bb-3634-4e95-946f-b96187884a68 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-vif-unplugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== connect_volume: return (2428ms) {'type': 'block', 'scsi_wwn': '23863373366393234', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863373366393234', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-323856204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-323856204',id=16,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-3bxuxzha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:27Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'pci_devices' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:40:42 user nova-compute[71500]:   <uuid>e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3</uuid>
Apr 14 15:40:42 user nova-compute[71500]:   <name>instance-00000010</name>
Apr 14 15:40:42 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:40:42 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:40:42 user nova-compute[71500]:   <metadata>
Apr 14 15:40:42 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:40:42 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:40:42 user nova-compute[71500]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-323856204</nova:name>
Apr 14 15:40:42 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:40:39</nova:creationTime>
Apr 14 15:40:42 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:40:42 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:40:42 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:40:42 user nova-compute[71500]:       <nova:owner>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:user uuid="efb645d110464e7e85d7c955ee9f3466">tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member</nova:user>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:project uuid="584a53650c014f87b9622f2011996200">tempest-ServerBootFromVolumeStableRescueTest-756745587</nova:project>
Apr 14 15:40:42 user nova-compute[71500]:       </nova:owner>
Apr 14 15:40:42 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:40:42 user nova-compute[71500]:       <nova:ports>
Apr 14 15:40:42 user nova-compute[71500]:         <nova:port uuid="18973ac2-c226-4d12-98e7-5bbee348527a">
Apr 14 15:40:42 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 15:40:42 user nova-compute[71500]:         </nova:port>
Apr 14 15:40:42 user nova-compute[71500]:       </nova:ports>
Apr 14 15:40:42 user nova-compute[71500]:     </nova:instance>
Apr 14 15:40:42 user nova-compute[71500]:   </metadata>
Apr 14 15:40:42 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:40:42 user nova-compute[71500]:     <system>
Apr 14 15:40:42 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:40:42 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:40:42 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:40:42 user nova-compute[71500]:       <entry name="serial">e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3</entry>
Apr 14 15:40:42 user nova-compute[71500]:       <entry name="uuid">e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3</entry>
Apr 14 15:40:42 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:40:42 user nova-compute[71500]:     </system>
Apr 14 15:40:42 user nova-compute[71500]:   </sysinfo>
Apr 14 15:40:42 user nova-compute[71500]:   <os>
Apr 14 15:40:42 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:40:42 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:40:42 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:40:42 user nova-compute[71500]:   </os>
Apr 14 15:40:42 user nova-compute[71500]:   <features>
Apr 14 15:40:42 user nova-compute[71500]:     <acpi/>
Apr 14 15:40:42 user nova-compute[71500]:     <apic/>
Apr 14 15:40:42 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:40:42 user nova-compute[71500]:   </features>
Apr 14 15:40:42 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:40:42 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:40:42 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:40:42 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:40:42 user nova-compute[71500]:   </clock>
Apr 14 15:40:42 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:40:42 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:40:42 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:40:42 user nova-compute[71500]:   </cpu>
Apr 14 15:40:42 user nova-compute[71500]:   <devices>
Apr 14 15:40:42 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:40:42 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:40:42 user nova-compute[71500]:       <source dev="/dev/sdc"/>
Apr 14 15:40:42 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:40:42 user nova-compute[71500]:       <serial>34a8d836-37e0-4250-9c77-0bec8d481ee4</serial>
Apr 14 15:40:42 user nova-compute[71500]:     </disk>
Apr 14 15:40:42 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:40:42 user nova-compute[71500]:       <mac address="fa:16:3e:88:f7:a1"/>
Apr 14 15:40:42 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:42 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:40:42 user nova-compute[71500]:       <target dev="tap18973ac2-c2"/>
Apr 14 15:40:42 user nova-compute[71500]:     </interface>
Apr 14 15:40:42 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:40:42 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/console.log" append="off"/>
Apr 14 15:40:42 user nova-compute[71500]:     </serial>
Apr 14 15:40:42 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:40:42 user nova-compute[71500]:     <video>
Apr 14 15:40:42 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:42 user nova-compute[71500]:     </video>
Apr 14 15:40:42 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:40:42 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:40:42 user nova-compute[71500]:     </rng>
Apr 14 15:40:42 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:40:42 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:40:42 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:40:42 user nova-compute[71500]:     </memballoon>
Apr 14 15:40:42 user nova-compute[71500]:   </devices>
Apr 14 15:40:42 user nova-compute[71500]: </domain>
Apr 14 15:40:42 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-323856204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-323856204',id=16,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-3bxuxzha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:27Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG os_vif [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18973ac2-c2, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18973ac2-c2, col_values=(('external_ids', {'iface-id': '18973ac2-c226-4d12-98e7-5bbee348527a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:f7:a1', 'vm-uuid': 'e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: INFO os_vif [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2')
Apr 14 15:40:42 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Instance destroyed successfully.
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.objects.instance [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lazy-loading 'resources' on Instance uuid 31b57881-e95e-41d5-9f78-61d95ecfd93a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-581725796',display_name='tempest-TestVolumeSwap-server-581725796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-581725796',id=8,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoPs0hr2S89qa5HJoTWExnkbcMJl7mVEmKXO1Z43KzeIRd82SH9/UKYZVvEh37jqfaLeW9ytkKTE2z/yCTgCYiPlndaiDPUtYOZHOLYZHmj1s0YcA3j9fEBYOveLu7ycw==',key_name='tempest-keypair-1390268231',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f84eb038f3914d54a892a6dabdf6f67b',ramdisk_id='',reservation_id='r-au0352wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-914090000',owner_user_name='tempest-TestVolumeSwap-914090000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8903273cb7ea4a0c9831dbcc74361ae2',uuid=31b57881-e95e-41d5-9f78-61d95ecfd93a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Converting VIF {"id": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "address": "fa:16:3e:e2:0b:f4", "network": {"id": "94222530-78ac-488b-a318-50b1ae27bc59", "bridge": "br-int", "label": "tempest-TestVolumeSwap-906863153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f84eb038f3914d54a892a6dabdf6f67b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bdad8ab-47", "ovs_interfaceid": "3bdad8ab-4716-4bb3-b21e-890e392b5430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG os_vif [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bdad8ab-47, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:42 user nova-compute[71500]: INFO os_vif [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:0b:f4,bridge_name='br-int',has_traffic_filtering=True,id=3bdad8ab-4716-4bb3-b21e-890e392b5430,network=Network(94222530-78ac-488b-a318-50b1ae27bc59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bdad8ab-47')
Apr 14 15:40:42 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Deleting instance files /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a_del
Apr 14 15:40:42 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Deletion of /opt/stack/data/nova/instances/31b57881-e95e-41d5-9f78-61d95ecfd93a_del complete
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No VIF found with MAC fa:16:3e:88:f7:a1, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:40:42 user nova-compute[71500]: INFO nova.compute.manager [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 15:40:42 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:40:42 user nova-compute[71500]: INFO nova.compute.manager [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Rescuing
Apr 14 15:40:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-vif-deleted-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:43 user nova-compute[71500]: INFO nova.compute.manager [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Neutron deleted interface 3bdad8ab-4716-4bb3-b21e-890e392b5430; detaching it from the instance and deleting it from the info cache
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.network.neutron [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:43 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Took 1.56 seconds to deallocate network for instance.
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-4a2bb146-f78d-4d51-9bd8-2e1d777330cf req-f3e7772f-b6d2-45f7-9d1d-2a0c9a8be36f service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Detach interface failed, port_id=3bdad8ab-4716-4bb3-b21e-890e392b5430, reason: Instance 31b57881-e95e-41d5-9f78-61d95ecfd93a could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received event network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Acquiring lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] No waiting events found dispatching network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:43 user nova-compute[71500]: WARNING nova.compute.manager [req-c05121fa-1321-4f17-8cda-1ff0f0f0b18c req-66584999-37d0-44ef-baf2-8d0735f33c13 service nova] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Received unexpected event network-vif-plugged-3bdad8ab-4716-4bb3-b21e-890e392b5430 for instance with vm_state active and task_state deleting.
Apr 14 15:40:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:44 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Deleted allocations for instance 31b57881-e95e-41d5-9f78-61d95ecfd93a
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7c828ce9-6740-4e29-978f-cc8cc1dbeb6f tempest-TestVolumeSwap-914090000 tempest-TestVolumeSwap-914090000-project-member] Lock "31b57881-e95e-41d5-9f78-61d95ecfd93a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.299s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:44 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance destroyed successfully.
Apr 14 15:40:44 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Attempting a stable device rescue
Apr 14 15:40:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71500) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:40:44 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Creating image(s)
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "3dccdb36e3fcaea72c2496ed07e716a93bbe3940" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "3dccdb36e3fcaea72c2496ed07e716a93bbe3940" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:45 user nova-compute[71500]: WARNING nova.compute.manager [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state rescuing.
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:45 user nova-compute[71500]: WARNING nova.compute.manager [req-39de382f-6be8-40af-9d4f-3cd0b08a7a71 req-f8f89402-b981-4a24-aad7-dca6274567fd service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state rescuing.
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.part --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.virt.images [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] c1382ef4-ea4d-4bc8-a660-6abf260444d7 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.part /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:45 user nova-compute[71500]: WARNING nova.compute.manager [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state building and task_state spawning.
Apr 14 15:40:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:46 user nova-compute[71500]: WARNING nova.compute.manager [req-d24b51f3-2b3f-4a00-9d50-4a3c5df4d267 req-52628a91-9b41-42b9-a1ec-02962f7d54bc service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state building and task_state spawning.
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486846.135939, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Resumed (Lifecycle Event)
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance spawned successfully.
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.part /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.converted" returned: 0 in 0.361s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486846.1382408, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Started (Lifecycle Event)
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Took 6.79 seconds to spawn the instance on the hypervisor.
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:40:46 user nova-compute[71500]: INFO nova.compute.manager [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Took 19.75 seconds to build instance.
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "3dccdb36e3fcaea72c2496ed07e716a93bbe3940" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.428s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "3dccdb36e3fcaea72c2496ed07e716a93bbe3940" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "3dccdb36e3fcaea72c2496ed07e716a93bbe3940" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3828897f-5d67-45bf-b48d-ad6c65bc0949 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.903s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940 --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940,backing_fmt=raw /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940,backing_fmt=raw /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue" returned: 0 in 0.047s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "3dccdb36e3fcaea72c2496ed07e716a93bbe3940" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'migration_context' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Start _get_guest_xml network_info=[{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "vif_mac": "fa:16:3e:2c:45:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c1382ef4-ea4d-4bc8-a660-6abf260444d7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '254876ae-f7a8-4156-acff-2783ff15c0a6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApwjImHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2d91a139-cb0c-40c1-99a1-6b34dcb60bed', 'attached_at': '', 'detached_at': '', 'volume_id': '2f60c4f2-a281-469b-9c0e-cf96631f965c', 'serial': '2f60c4f2-a281-469b-9c0e-cf96631f965c'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'resources' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApwjImHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:40:46 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:40:46 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:40:46 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06795f-1b73-48ce-ad8b-a0a197654b1c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ApwjImHT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 15:40:46 user nova-compute[71500]: node.name = iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c
Apr 14 15:40:46 user nova-compute[71500]: node.tpgt = -1
Apr 14 15:40:46 user nova-compute[71500]: node.startup = automatic
Apr 14 15:40:46 user nova-compute[71500]: node.leading_login = No
Apr 14 15:40:46 user nova-compute[71500]: iface.iscsi_ifacename = default
Apr 14 15:40:46 user nova-compute[71500]: iface.net_ifacename = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.ipaddress = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.prefix_len = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.hwaddress = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.transport_name = tcp
Apr 14 15:40:46 user nova-compute[71500]: iface.initiatorname = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.vlan_id = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.vlan_priority = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.vlan_state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.iface_num = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.mtu = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.port = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.bootproto = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.subnet_mask = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.gateway = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_alt_client_id = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_dns = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_learn_iqn = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_vendor_id_state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_vendor_id = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.dhcp_slp_da = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.fragmentation = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.gratuitous_arp = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.incoming_forwarding = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.tos_state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.tos = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.ttl = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.delayed_ack = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.tcp_nagle = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.tcp_wsf_state = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.tcp_wsf = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.tcp_timer_scale = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.tcp_timestamp = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.redirect = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.def_task_mgmt_timeout = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.header_digest = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.data_digest = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.immediate_data = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.initial_r2t = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.data_seq_inorder = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.data_pdu_inorder = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.erl = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.max_receive_data_len = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.first_burst_len = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.max_outstanding_r2t = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.max_burst_len = 0
Apr 14 15:40:46 user nova-compute[71500]: iface.chap_auth = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.bidi_chap = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.strict_login_compliance = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.discovery_auth = <empty>
Apr 14 15:40:46 user nova-compute[71500]: iface.discovery_logout = <empty>
Apr 14 15:40:46 user nova-compute[71500]: node.discovery_address = <empty>
Apr 14 15:40:46 user nova-compute[71500]: node.discovery_port = 0
Apr 14 15:40:46 user nova-compute[71500]: node.discovery_type = static
Apr 14 15:40:46 user nova-compute[71500]: node.session.initial_cmdsn = 0
Apr 14 15:40:46 user nova-compute[71500]: node.session.initial_login_retry_max = 8
Apr 14 15:40:46 user nova-compute[71500]: node.session.xmit_thread_priority = -20
Apr 14 15:40:46 user nova-compute[71500]: node.session.cmds_max = 128
Apr 14 15:40:46 user nova-compute[71500]: node.session.queue_depth = 32
Apr 14 15:40:46 user nova-compute[71500]: node.session.nr_sessions = 1
Apr 14 15:40:46 user nova-compute[71500]: node.session.auth.authmethod = CHAP
Apr 14 15:40:46 user nova-compute[71500]: node.session.auth.username = ApwjImHT
Apr 14 15:40:46 user nova-compute[71500]: node.session.auth.password = ***
Apr 14 15:40:46 user nova-compute[71500]: node.session.auth.username_in = <empty>
Apr 14 15:40:46 user nova-compute[71500]: node.session.auth.password_in = <empty>
Apr 14 15:40:46 user nova-compute[71500]: node.session.auth.chap_algs = MD5
Apr 14 15:40:46 user nova-compute[71500]: node.session.timeo.replacement_timeout = 120
Apr 14 15:40:46 user nova-compute[71500]: node.session.err_timeo.abort_timeout = 15
Apr 14 15:40:46 user nova-compute[71500]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 15:40:46 user nova-compute[71500]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 15:40:46 user nova-compute[71500]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.FastAbort = Yes
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.InitialR2T = No
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.ImmediateData = Yes
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.MaxConnections = 1
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 15:40:46 user nova-compute[71500]: node.session.iscsi.ERL = 0
Apr 14 15:40:46 user nova-compute[71500]: node.session.scan = manual
Apr 14 15:40:46 user nova-compute[71500]: node.session.reopen_max = 0
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].address = 172.16.0.220
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].port = 3260
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].startup = manual
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].tcp.window_size = 524288
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].tcp.type_of_service = 0
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].timeo.logout_timeout = 15
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].timeo.login_timeout = 15
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].timeo.auth_timeout = 45
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].iscsi.DataDigest = None
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].iscsi.IFMarker = No
Apr 14 15:40:46 user nova-compute[71500]: node.conn[0].iscsi.OFMarker = No
Apr 14 15:40:46 user nova-compute[71500]: # END RECORD
Apr 14 15:40:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b452b4-3566-4d58-b95a-e79632fee6cf]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5387a99-d5b3-4aca-a2d7-cd85b4cd60d8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApwjImHT {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApwjImHT" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[63431ff2-6a92-4a01-9da9-e17a76c38889]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ApwjImHT'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.110s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[96916e32-3c4d-4fc3-97d6-ec5a125eff9f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:40:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3bd8e-601e-41c2-be98-c43ba100ab2f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:47 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:40:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:40:47 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:40:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] HCTL ('33', '0', '0', 0) found on session 15 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3cbf0b-df84-4ec0-9a66-5bc0271ebe26]: (4, ('0 0 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Searching for a device in session 15 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApwjImHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.294s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] <== connect_volume: return (295ms) {'type': 'block', 'scsi_wwn': '26662376661623630', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662376661623630', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-660406846',display_name='tempest-ServerStableDeviceRescueTest-server-660406846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-660406846',id=4,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvPHEwKozg7h6r4JnJpSzBWhs511e+AcMrK/R2mBj8TGR21rZjvip0yg4hAZLhZammhHG2RLycjW8OY5YH3WpdSWl4G97OD9UkFa1PzKidrzi0TtxEVyGAc8SnkIc1I4Q==',key_name='tempest-keypair-985297908',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8230c5386464f288fd783b3c60536b4',ramdisk_id='',reservation_id='r-m8khbov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2130046820',owner_user_name='tempest-ServerStableDeviceRescueTest-2130046820-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:38:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f805db20d87d4429981c975ebd88ed92',uuid=2d91a139-cb0c-40c1-99a1-6b34dcb60bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "vif_mac": "fa:16:3e:2c:45:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converting VIF {"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "vif_mac": "fa:16:3e:2c:45:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:40:47 user nova-compute[71500]:   <uuid>2d91a139-cb0c-40c1-99a1-6b34dcb60bed</uuid>
Apr 14 15:40:47 user nova-compute[71500]:   <name>instance-00000004</name>
Apr 14 15:40:47 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:40:47 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:40:47 user nova-compute[71500]:   <metadata>
Apr 14 15:40:47 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:40:47 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:40:47 user nova-compute[71500]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-660406846</nova:name>
Apr 14 15:40:47 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:40:46</nova:creationTime>
Apr 14 15:40:47 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:40:47 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:40:47 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:40:47 user nova-compute[71500]:       <nova:owner>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:user uuid="f805db20d87d4429981c975ebd88ed92">tempest-ServerStableDeviceRescueTest-2130046820-project-member</nova:user>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:project uuid="a8230c5386464f288fd783b3c60536b4">tempest-ServerStableDeviceRescueTest-2130046820</nova:project>
Apr 14 15:40:47 user nova-compute[71500]:       </nova:owner>
Apr 14 15:40:47 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:40:47 user nova-compute[71500]:       <nova:ports>
Apr 14 15:40:47 user nova-compute[71500]:         <nova:port uuid="cfb03b4e-c244-4ebd-bff5-7e250ac32044">
Apr 14 15:40:47 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:40:47 user nova-compute[71500]:         </nova:port>
Apr 14 15:40:47 user nova-compute[71500]:       </nova:ports>
Apr 14 15:40:47 user nova-compute[71500]:     </nova:instance>
Apr 14 15:40:47 user nova-compute[71500]:   </metadata>
Apr 14 15:40:47 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:40:47 user nova-compute[71500]:     <system>
Apr 14 15:40:47 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:40:47 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:40:47 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:40:47 user nova-compute[71500]:       <entry name="serial">2d91a139-cb0c-40c1-99a1-6b34dcb60bed</entry>
Apr 14 15:40:47 user nova-compute[71500]:       <entry name="uuid">2d91a139-cb0c-40c1-99a1-6b34dcb60bed</entry>
Apr 14 15:40:47 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:40:47 user nova-compute[71500]:     </system>
Apr 14 15:40:47 user nova-compute[71500]:   </sysinfo>
Apr 14 15:40:47 user nova-compute[71500]:   <os>
Apr 14 15:40:47 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:40:47 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:40:47 user nova-compute[71500]:   </os>
Apr 14 15:40:47 user nova-compute[71500]:   <features>
Apr 14 15:40:47 user nova-compute[71500]:     <acpi/>
Apr 14 15:40:47 user nova-compute[71500]:     <apic/>
Apr 14 15:40:47 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:40:47 user nova-compute[71500]:   </features>
Apr 14 15:40:47 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:40:47 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:40:47 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:40:47 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:40:47 user nova-compute[71500]:   </clock>
Apr 14 15:40:47 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:40:47 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:40:47 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:40:47 user nova-compute[71500]:   </cpu>
Apr 14 15:40:47 user nova-compute[71500]:   <devices>
Apr 14 15:40:47 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:40:47 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:40:47 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk"/>
Apr 14 15:40:47 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:40:47 user nova-compute[71500]:     </disk>
Apr 14 15:40:47 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:40:47 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:40:47 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 15:40:47 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:40:47 user nova-compute[71500]:       <serial>2f60c4f2-a281-469b-9c0e-cf96631f965c</serial>
Apr 14 15:40:47 user nova-compute[71500]:     </disk>
Apr 14 15:40:47 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:40:47 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:40:47 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue"/>
Apr 14 15:40:47 user nova-compute[71500]:       <target dev="vdc" bus="virtio"/>
Apr 14 15:40:47 user nova-compute[71500]:       <boot order="1"/>
Apr 14 15:40:47 user nova-compute[71500]:     </disk>
Apr 14 15:40:47 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:40:47 user nova-compute[71500]:       <mac address="fa:16:3e:2c:45:27"/>
Apr 14 15:40:47 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:47 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:40:47 user nova-compute[71500]:       <target dev="tapcfb03b4e-c2"/>
Apr 14 15:40:47 user nova-compute[71500]:     </interface>
Apr 14 15:40:47 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:40:47 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/console.log" append="off"/>
Apr 14 15:40:47 user nova-compute[71500]:     </serial>
Apr 14 15:40:47 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:40:47 user nova-compute[71500]:     <video>
Apr 14 15:40:47 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:47 user nova-compute[71500]:     </video>
Apr 14 15:40:47 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:40:47 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:40:47 user nova-compute[71500]:     </rng>
Apr 14 15:40:47 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:40:47 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:40:47 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:40:47 user nova-compute[71500]:     </memballoon>
Apr 14 15:40:47 user nova-compute[71500]:   </devices>
Apr 14 15:40:47 user nova-compute[71500]: </domain>
Apr 14 15:40:47 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:40:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance destroyed successfully.
Apr 14 15:40:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] No VIF found with MAC fa:16:3e:2c:45:27, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:40:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:49 user nova-compute[71500]: WARNING nova.compute.manager [req-18503942-10b9-45b4-bfc8-9e1adc7edde1 req-ae208edb-8e38-41c9-b598-a6a895855261 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state rescuing.
Apr 14 15:40:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:40:51 user nova-compute[71500]: WARNING nova.compute.manager [req-e0930b29-68a1-4d45-94d8-19a2875da9ba req-cb743f75-eb77-49d3-96b0-e454475ff520 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state rescuing.
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 2d91a139-cb0c-40c1-99a1-6b34dcb60bed due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486851.2821765, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Resumed (Lifecycle Event)
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9421e20f-9b65-499e-8dd5-85a10fb5d95a tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:40:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486851.2915137, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Started (Lifecycle Event)
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:40:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:40:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:54 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:40:54 user nova-compute[71500]: INFO nova.compute.claims [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Claim successful on node user
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:40:55 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:40:55 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Creating image(s)
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.155s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG nova.policy [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk 1073741824" returned: 0 in 0.054s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Cannot resize image /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'migration_context' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Ensure instance console log exists: /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:40:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Successfully created port: f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486842.1452255, 31b57881-e95e-41d5-9f78-61d95ecfd93a => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:40:57 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] VM Stopped (Lifecycle Event)
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-481a6c14-291f-42b7-9b1b-98c2787ea5eb None None] [instance: 31b57881-e95e-41d5-9f78-61d95ecfd93a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Successfully updated port: f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-changed-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Refreshing instance network info cache due to event network-changed-f5a1caf6-baf3-4c27-82c9-aab287c07447. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:40:57 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance network_info: |[{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Refreshing network info cache for port f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start _get_guest_xml network_info=[{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:40:58 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:58 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1856157720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_devices' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:40:58 user nova-compute[71500]:   <uuid>fd224b68-1cc6-48cc-bcfe-a1ce40252e65</uuid>
Apr 14 15:40:58 user nova-compute[71500]:   <name>instance-00000011</name>
Apr 14 15:40:58 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:40:58 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:40:58 user nova-compute[71500]:   <metadata>
Apr 14 15:40:58 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:40:58 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:40:58 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-1856157720</nova:name>
Apr 14 15:40:58 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:40:58</nova:creationTime>
Apr 14 15:40:58 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:40:58 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:40:58 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:40:58 user nova-compute[71500]:       <nova:owner>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:40:58 user nova-compute[71500]:       </nova:owner>
Apr 14 15:40:58 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:40:58 user nova-compute[71500]:       <nova:ports>
Apr 14 15:40:58 user nova-compute[71500]:         <nova:port uuid="f5a1caf6-baf3-4c27-82c9-aab287c07447">
Apr 14 15:40:58 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:40:58 user nova-compute[71500]:         </nova:port>
Apr 14 15:40:58 user nova-compute[71500]:       </nova:ports>
Apr 14 15:40:58 user nova-compute[71500]:     </nova:instance>
Apr 14 15:40:58 user nova-compute[71500]:   </metadata>
Apr 14 15:40:58 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:40:58 user nova-compute[71500]:     <system>
Apr 14 15:40:58 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:40:58 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:40:58 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:40:58 user nova-compute[71500]:       <entry name="serial">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:40:58 user nova-compute[71500]:       <entry name="uuid">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:40:58 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:40:58 user nova-compute[71500]:     </system>
Apr 14 15:40:58 user nova-compute[71500]:   </sysinfo>
Apr 14 15:40:58 user nova-compute[71500]:   <os>
Apr 14 15:40:58 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:40:58 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:40:58 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:40:58 user nova-compute[71500]:   </os>
Apr 14 15:40:58 user nova-compute[71500]:   <features>
Apr 14 15:40:58 user nova-compute[71500]:     <acpi/>
Apr 14 15:40:58 user nova-compute[71500]:     <apic/>
Apr 14 15:40:58 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:40:58 user nova-compute[71500]:   </features>
Apr 14 15:40:58 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:40:58 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:40:58 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:40:58 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:40:58 user nova-compute[71500]:   </clock>
Apr 14 15:40:58 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:40:58 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:40:58 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:40:58 user nova-compute[71500]:   </cpu>
Apr 14 15:40:58 user nova-compute[71500]:   <devices>
Apr 14 15:40:58 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:40:58 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:40:58 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk"/>
Apr 14 15:40:58 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:40:58 user nova-compute[71500]:     </disk>
Apr 14 15:40:58 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:40:58 user nova-compute[71500]:       <mac address="fa:16:3e:23:f4:2a"/>
Apr 14 15:40:58 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:58 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:40:58 user nova-compute[71500]:       <target dev="tapf5a1caf6-ba"/>
Apr 14 15:40:58 user nova-compute[71500]:     </interface>
Apr 14 15:40:58 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:40:58 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log" append="off"/>
Apr 14 15:40:58 user nova-compute[71500]:     </serial>
Apr 14 15:40:58 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:40:58 user nova-compute[71500]:     <video>
Apr 14 15:40:58 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:40:58 user nova-compute[71500]:     </video>
Apr 14 15:40:58 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:40:58 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:40:58 user nova-compute[71500]:     </rng>
Apr 14 15:40:58 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:40:58 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:40:58 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:40:58 user nova-compute[71500]:     </memballoon>
Apr 14 15:40:58 user nova-compute[71500]:   </devices>
Apr 14 15:40:58 user nova-compute[71500]: </domain>
Apr 14 15:40:58 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1856157720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG os_vif [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a1caf6-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5a1caf6-ba, col_values=(('external_ids', {'iface-id': 'f5a1caf6-baf3-4c27-82c9-aab287c07447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:f4:2a', 'vm-uuid': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:58 user nova-compute[71500]: INFO os_vif [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:23:f4:2a, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updated VIF entry in instance network info cache for port f5a1caf6-baf3-4c27-82c9-aab287c07447. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:40:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-acc231a4-0aba-49d7-a250-1822cfc8beb9 req-2ee3fa07-89b4-4c69-95ee-5383d73ee213 service nova] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:40:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:40:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:00 user nova-compute[71500]: WARNING nova.compute.manager [req-75154a95-00c5-4410-bf9a-e150faf95f98 req-3df3c110-92c0-4f34-a5c9-6f321f6d21f4 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state building and task_state spawning.
Apr 14 15:41:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:02 user nova-compute[71500]: WARNING nova.compute.manager [req-02b285d9-7df8-4487-a53a-71bc6c7a0831 req-18bfabd6-fe54-423d-ad9f-7e9c273537e6 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state building and task_state spawning.
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486862.6827052, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Resumed (Lifecycle Event)
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance spawned successfully.
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486862.6858976, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Started (Lifecycle Event)
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Took 7.40 seconds to spawn the instance on the hypervisor.
Apr 14 15:41:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:02 user nova-compute[71500]: INFO nova.compute.manager [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Took 8.33 seconds to build instance.
Apr 14 15:41:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4646dd49-53bd-4e34-949b-7a8b36a6f290 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.459s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:41:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:41:30 user nova-compute[71500]: INFO nova.compute.claims [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Claim successful on node user
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.581s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:41:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.policy [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:41:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Creating image(s)
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "590ae696743c231c4e6862d46573684b4801efd9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "590ae696743c231c4e6862d46573684b4801efd9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:31 user nova-compute[71500]: INFO nova.compute.manager [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Rescuing
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:41:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.part --force-share --output=json" returned: 0 in 0.239s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG nova.virt.images [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 07f87bf5-ccf2-4c81-8d43-c1a9d8492556 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.part /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.part /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.converted" returned: 0 in 0.321s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Successfully created port: 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "590ae696743c231c4e6862d46573684b4801efd9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.172s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "590ae696743c231c4e6862d46573684b4801efd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "590ae696743c231c4e6862d46573684b4801efd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json" returned: 0 in 0.171s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9,backing_fmt=raw /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9,backing_fmt=raw /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk 1073741824" returned: 0 in 0.089s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "590ae696743c231c4e6862d46573684b4801efd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Cannot resize image /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'migration_context' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Ensure instance console log exists: /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:33 user nova-compute[71500]: WARNING nova.compute.manager [req-b976f0a2-2d54-4d46-8a5f-65fb2b2bcf6b req-85827bcd-6923-47a2-a842-ea199a23e66e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state active and task_state rescuing.
Apr 14 15:41:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance destroyed successfully.
Apr 14 15:41:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Attempting rescue
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71500) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:41:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Creating image(s)
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue" returned: 0 in 0.081s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'migration_context' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Start _get_guest_xml network_info=[{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:ad:84:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'resources' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'numa_topology' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:34 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:41:34 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-797939149',display_name='tempest-ServerRescueNegativeTestJSON-server-797939149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-797939149',id=5,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:36:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-4lrfed09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:36:57Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=0f27f459-5b11-4564-ab4c-7194b18319f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:ad:84:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:ad:84:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:41:34 user nova-compute[71500]:   <uuid>0f27f459-5b11-4564-ab4c-7194b18319f4</uuid>
Apr 14 15:41:34 user nova-compute[71500]:   <name>instance-00000005</name>
Apr 14 15:41:34 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:41:34 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:41:34 user nova-compute[71500]:   <metadata>
Apr 14 15:41:34 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:41:34 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:41:34 user nova-compute[71500]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-797939149</nova:name>
Apr 14 15:41:34 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:41:34</nova:creationTime>
Apr 14 15:41:34 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:41:34 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:41:34 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:41:34 user nova-compute[71500]:       <nova:owner>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:user uuid="3fa924fefda1428d81152fd573540f26">tempest-ServerRescueNegativeTestJSON-1174024196-project-member</nova:user>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:project uuid="609ac7b149e14baab270d83a2646fbdf">tempest-ServerRescueNegativeTestJSON-1174024196</nova:project>
Apr 14 15:41:34 user nova-compute[71500]:       </nova:owner>
Apr 14 15:41:34 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:41:34 user nova-compute[71500]:       <nova:ports>
Apr 14 15:41:34 user nova-compute[71500]:         <nova:port uuid="e9820d0e-cb0f-4d8e-b071-3c6c616bf863">
Apr 14 15:41:34 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 15:41:34 user nova-compute[71500]:         </nova:port>
Apr 14 15:41:34 user nova-compute[71500]:       </nova:ports>
Apr 14 15:41:34 user nova-compute[71500]:     </nova:instance>
Apr 14 15:41:34 user nova-compute[71500]:   </metadata>
Apr 14 15:41:34 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:41:34 user nova-compute[71500]:     <system>
Apr 14 15:41:34 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:41:34 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:41:34 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:41:34 user nova-compute[71500]:       <entry name="serial">0f27f459-5b11-4564-ab4c-7194b18319f4</entry>
Apr 14 15:41:34 user nova-compute[71500]:       <entry name="uuid">0f27f459-5b11-4564-ab4c-7194b18319f4</entry>
Apr 14 15:41:34 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:41:34 user nova-compute[71500]:     </system>
Apr 14 15:41:34 user nova-compute[71500]:   </sysinfo>
Apr 14 15:41:34 user nova-compute[71500]:   <os>
Apr 14 15:41:34 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:41:34 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:41:34 user nova-compute[71500]:   </os>
Apr 14 15:41:34 user nova-compute[71500]:   <features>
Apr 14 15:41:34 user nova-compute[71500]:     <acpi/>
Apr 14 15:41:34 user nova-compute[71500]:     <apic/>
Apr 14 15:41:34 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:41:34 user nova-compute[71500]:   </features>
Apr 14 15:41:34 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:41:34 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:41:34 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:41:34 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:41:34 user nova-compute[71500]:   </clock>
Apr 14 15:41:34 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:41:34 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:41:34 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:41:34 user nova-compute[71500]:   </cpu>
Apr 14 15:41:34 user nova-compute[71500]:   <devices>
Apr 14 15:41:34 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:41:34 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:41:34 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue"/>
Apr 14 15:41:34 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:41:34 user nova-compute[71500]:     </disk>
Apr 14 15:41:34 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:41:34 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:41:34 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk"/>
Apr 14 15:41:34 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:41:34 user nova-compute[71500]:     </disk>
Apr 14 15:41:34 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:41:34 user nova-compute[71500]:       <mac address="fa:16:3e:ad:84:39"/>
Apr 14 15:41:34 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:41:34 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:41:34 user nova-compute[71500]:       <target dev="tape9820d0e-cb"/>
Apr 14 15:41:34 user nova-compute[71500]:     </interface>
Apr 14 15:41:34 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:41:34 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/console.log" append="off"/>
Apr 14 15:41:34 user nova-compute[71500]:     </serial>
Apr 14 15:41:34 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:41:34 user nova-compute[71500]:     <video>
Apr 14 15:41:34 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:41:34 user nova-compute[71500]:     </video>
Apr 14 15:41:34 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:41:34 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:41:34 user nova-compute[71500]:     </rng>
Apr 14 15:41:34 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:41:34 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:41:34 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:41:34 user nova-compute[71500]:     </memballoon>
Apr 14 15:41:34 user nova-compute[71500]:   </devices>
Apr 14 15:41:34 user nova-compute[71500]: </domain>
Apr 14 15:41:34 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:41:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance destroyed successfully.
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:ad:84:39, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Successfully updated port: 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:41:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance network_info: |[{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Start _get_guest_xml network_info=[{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:41:27Z,direct_url=<?>,disk_format='qcow2',id=07f87bf5-ccf2-4c81-8d43-c1a9d8492556,min_disk=0,min_ram=0,name='tempest-scenario-img--997096802',owner='6d21cbc9fcc74fdd8579bad00a8ba2eb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:41:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': '07f87bf5-ccf2-4c81-8d43-c1a9d8492556'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:41:35 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:41:35 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:41:27Z,direct_url=<?>,disk_format='qcow2',id=07f87bf5-ccf2-4c81-8d43-c1a9d8492556,min_disk=0,min_ram=0,name='tempest-scenario-img--997096802',owner='6d21cbc9fcc74fdd8579bad00a8ba2eb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:41:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1381069102',display_name='tempest-TestMinimumBasicScenario-server-1381069102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1381069102',id=18,image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw==',key_name='tempest-TestMinimumBasicScenario-1176689891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-0olith0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:41:31Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=d7088d6e-b443-4c76-8a13-199e0721ea36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'pci_devices' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:41:35 user nova-compute[71500]:   <uuid>d7088d6e-b443-4c76-8a13-199e0721ea36</uuid>
Apr 14 15:41:35 user nova-compute[71500]:   <name>instance-00000012</name>
Apr 14 15:41:35 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:41:35 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:41:35 user nova-compute[71500]:   <metadata>
Apr 14 15:41:35 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:41:35 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:41:35 user nova-compute[71500]:       <nova:name>tempest-TestMinimumBasicScenario-server-1381069102</nova:name>
Apr 14 15:41:35 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:41:35</nova:creationTime>
Apr 14 15:41:35 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:41:35 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:41:35 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:41:35 user nova-compute[71500]:       <nova:owner>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:user uuid="4e5d615d61ea4b1dafa4207d7b21e2d5">tempest-TestMinimumBasicScenario-554859149-project-member</nova:user>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:project uuid="6d21cbc9fcc74fdd8579bad00a8ba2eb">tempest-TestMinimumBasicScenario-554859149</nova:project>
Apr 14 15:41:35 user nova-compute[71500]:       </nova:owner>
Apr 14 15:41:35 user nova-compute[71500]:       <nova:root type="image" uuid="07f87bf5-ccf2-4c81-8d43-c1a9d8492556"/>
Apr 14 15:41:35 user nova-compute[71500]:       <nova:ports>
Apr 14 15:41:35 user nova-compute[71500]:         <nova:port uuid="05127b2a-2e86-4f6a-9fb3-9e2be5559bde">
Apr 14 15:41:35 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 15:41:35 user nova-compute[71500]:         </nova:port>
Apr 14 15:41:35 user nova-compute[71500]:       </nova:ports>
Apr 14 15:41:35 user nova-compute[71500]:     </nova:instance>
Apr 14 15:41:35 user nova-compute[71500]:   </metadata>
Apr 14 15:41:35 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:41:35 user nova-compute[71500]:     <system>
Apr 14 15:41:35 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:41:35 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:41:35 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:41:35 user nova-compute[71500]:       <entry name="serial">d7088d6e-b443-4c76-8a13-199e0721ea36</entry>
Apr 14 15:41:35 user nova-compute[71500]:       <entry name="uuid">d7088d6e-b443-4c76-8a13-199e0721ea36</entry>
Apr 14 15:41:35 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:41:35 user nova-compute[71500]:     </system>
Apr 14 15:41:35 user nova-compute[71500]:   </sysinfo>
Apr 14 15:41:35 user nova-compute[71500]:   <os>
Apr 14 15:41:35 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:41:35 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:41:35 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:41:35 user nova-compute[71500]:   </os>
Apr 14 15:41:35 user nova-compute[71500]:   <features>
Apr 14 15:41:35 user nova-compute[71500]:     <acpi/>
Apr 14 15:41:35 user nova-compute[71500]:     <apic/>
Apr 14 15:41:35 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:41:35 user nova-compute[71500]:   </features>
Apr 14 15:41:35 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:41:35 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:41:35 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:41:35 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:41:35 user nova-compute[71500]:   </clock>
Apr 14 15:41:35 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:41:35 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:41:35 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:41:35 user nova-compute[71500]:   </cpu>
Apr 14 15:41:35 user nova-compute[71500]:   <devices>
Apr 14 15:41:35 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:41:35 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:41:35 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk"/>
Apr 14 15:41:35 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:41:35 user nova-compute[71500]:     </disk>
Apr 14 15:41:35 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:41:35 user nova-compute[71500]:       <mac address="fa:16:3e:20:73:6b"/>
Apr 14 15:41:35 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:41:35 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:41:35 user nova-compute[71500]:       <target dev="tap05127b2a-2e"/>
Apr 14 15:41:35 user nova-compute[71500]:     </interface>
Apr 14 15:41:35 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:41:35 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/console.log" append="off"/>
Apr 14 15:41:35 user nova-compute[71500]:     </serial>
Apr 14 15:41:35 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:41:35 user nova-compute[71500]:     <video>
Apr 14 15:41:35 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:41:35 user nova-compute[71500]:     </video>
Apr 14 15:41:35 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:41:35 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:41:35 user nova-compute[71500]:     </rng>
Apr 14 15:41:35 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:41:35 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:41:35 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:41:35 user nova-compute[71500]:     </memballoon>
Apr 14 15:41:35 user nova-compute[71500]:   </devices>
Apr 14 15:41:35 user nova-compute[71500]: </domain>
Apr 14 15:41:35 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1381069102',display_name='tempest-TestMinimumBasicScenario-server-1381069102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1381069102',id=18,image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw==',key_name='tempest-TestMinimumBasicScenario-1176689891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-0olith0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:41:31Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=d7088d6e-b443-4c76-8a13-199e0721ea36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG os_vif [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05127b2a-2e, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05127b2a-2e, col_values=(('external_ids', {'iface-id': '05127b2a-2e86-4f6a-9fb3-9e2be5559bde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:73:6b', 'vm-uuid': 'd7088d6e-b443-4c76-8a13-199e0721ea36'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:35 user nova-compute[71500]: INFO os_vif [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e')
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No VIF found with MAC fa:16:3e:20:73:6b, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing instance network info cache due to event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:41:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updated VIF entry in instance network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:36 user nova-compute[71500]: WARNING nova.compute.manager [req-cac2dc32-08d2-4671-ad3c-c559e1c6d4a5 req-10075824-469d-4a02-a7ca-278dd5cf1762 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state active and task_state rescuing.
Apr 14 15:41:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:38 user nova-compute[71500]: WARNING nova.compute.manager [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state active and task_state rescuing.
Apr 14 15:41:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:38 user nova-compute[71500]: WARNING nova.compute.manager [req-731762bc-acba-4063-bdc6-d4f703e65f16 req-f4f9b98e-1ef7-4159-8027-ecfccd1b7e5e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state active and task_state rescuing.
Apr 14 15:41:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:38 user nova-compute[71500]: WARNING nova.compute.manager [req-9178df11-31a1-4615-b16f-1d3a6e262710 req-3f84e9e8-32b5-48b9-8752-079717398c68 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state building and task_state spawning.
Apr 14 15:41:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:41:41 user nova-compute[71500]: WARNING nova.compute.manager [req-129bf4d1-5092-4a3c-bd5a-272507054dac req-7782fe1b-5354-4c4e-a3c3-ede539de5a5e service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state building and task_state spawning.
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486901.706298, d7088d6e-b443-4c76-8a13-199e0721ea36 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] VM Resumed (Lifecycle Event)
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance spawned successfully.
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-30f8a474-7ffc-41bc-bf05-ea19d260f6fa tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486901.706486, d7088d6e-b443-4c76-8a13-199e0721ea36 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] VM Started (Lifecycle Event)
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 0f27f459-5b11-4564-ab4c-7194b18319f4 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486901.7408645, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Resumed (Lifecycle Event)
Apr 14 15:41:41 user nova-compute[71500]: INFO nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Took 10.51 seconds to spawn the instance on the hypervisor.
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:41:42 user nova-compute[71500]: INFO nova.compute.manager [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Took 11.48 seconds to build instance.
Apr 14 15:41:42 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486901.744029, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:41:42 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Started (Lifecycle Event)
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ae6d4630-bb87-4820-8be2-bff326973d88 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.613s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:41:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:41:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:41:47 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:41:47 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=26.244525909423828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f094302b-0730-4754-b9e9-ec203312b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 19de875a-a784-46f6-8c6e-f2fad198ba32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d7088d6e-b443-4c76-8a13-199e0721ea36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:41:47 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:41:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:41:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:41:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:41:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:02 user nova-compute[71500]: INFO nova.compute.manager [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Terminating instance
Apr 14 15:42:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-vif-unplugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] No waiting events found dispatching network-vif-unplugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-62a805fa-908a-4588-bf02-f112631687da req-e519c2d4-f739-46ad-9035-6e0330a47b32 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-vif-unplugged-12f4faa8-1f30-4403-9114-14195ee6d862 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Instance destroyed successfully.
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.objects.instance [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'resources' on Instance uuid 19de875a-a784-46f6-8c6e-f2fad198ba32 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1429675285',display_name='tempest-VolumesAdminNegativeTest-server-1429675285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1429675285',id=15,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='029b8c395f264a86933a9e878c18e0b2',ramdisk_id='',reservation_id='r-mf71yp7h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1127532',owner_user_name='tempest-VolumesAdminNegativeTest-1127532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:40:13Z,user_data=None,user_id='e1aa921f86bd4f3b88eb782d5f667816',uuid=19de875a-a784-46f6-8c6e-f2fad198ba32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converting VIF {"id": "12f4faa8-1f30-4403-9114-14195ee6d862", "address": "fa:16:3e:19:0a:4f", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12f4faa8-1f", "ovs_interfaceid": "12f4faa8-1f30-4403-9114-14195ee6d862", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG os_vif [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12f4faa8-1f, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:42:03 user nova-compute[71500]: INFO os_vif [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:0a:4f,bridge_name='br-int',has_traffic_filtering=True,id=12f4faa8-1f30-4403-9114-14195ee6d862,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12f4faa8-1f')
Apr 14 15:42:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Deleting instance files /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32_del
Apr 14 15:42:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Deletion of /opt/stack/data/nova/instances/19de875a-a784-46f6-8c6e-f2fad198ba32_del complete
Apr 14 15:42:03 user nova-compute[71500]: INFO nova.compute.manager [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 15:42:03 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:42:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:04 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:04 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Took 1.24 seconds to deallocate network for instance.
Apr 14 15:42:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-517c3a8a-ccca-466a-b16a-a67a1706b0bc req-a9ab9d36-aeb5-4ad0-b4bc-d0525e592b2c service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-vif-deleted-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received event network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Acquiring lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] No waiting events found dispatching network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:05 user nova-compute[71500]: WARNING nova.compute.manager [req-686f81c0-8890-4f7b-94ba-d88ad534ca89 req-ceba6cab-3672-4cae-ac4c-000028cab622 service nova] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Received unexpected event network-vif-plugged-12f4faa8-1f30-4403-9114-14195ee6d862 for instance with vm_state deleted and task_state None.
Apr 14 15:42:05 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:42:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:05 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Deleted allocations for instance 19de875a-a784-46f6-8c6e-f2fad198ba32
Apr 14 15:42:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0b1f2055-0266-4c55-afa5-0fa946c69b45 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "19de875a-a784-46f6-8c6e-f2fad198ba32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:17 user nova-compute[71500]: INFO nova.compute.manager [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Rescuing
Apr 14 15:42:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:42:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:42:17 user nova-compute[71500]: DEBUG nova.network.neutron [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG nova.network.neutron [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486923.4311025, 19de875a-a784-46f6-8c6e-f2fad198ba32 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:42:18 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] VM Stopped (Lifecycle Event)
Apr 14 15:42:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8f77a586-01f8-49d6-aca1-546b4df3ba3f None None] [instance: 19de875a-a784-46f6-8c6e-f2fad198ba32] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:18 user nova-compute[71500]: WARNING nova.compute.manager [req-5f44c28d-8212-4ff1-8988-6c8f3acbfecc req-977e309b-df8c-4503-a171-4bc4238c0fb7 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state active and task_state rescuing.
Apr 14 15:42:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance destroyed successfully.
Apr 14 15:42:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Attempting a stable device rescue
Apr 14 15:42:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71500) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 15:42:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:42:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Creating image(s)
Apr 14 15:42:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "/opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'trusted_certs' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "f1ac2641e3e032590530f4a725101bd73513746f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f1ac2641e3e032590530f4a725101bd73513746f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.part --force-share --output=json" returned: 0 in 0.173s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG nova.virt.images [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 8aae4aad-6003-4434-bde0-93ff7ad3d2b1 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.part /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.part /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.converted" returned: 0 in 0.231s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f1ac2641e3e032590530f4a725101bd73513746f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.567s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "f1ac2641e3e032590530f4a725101bd73513746f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f1ac2641e3e032590530f4a725101bd73513746f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:20 user nova-compute[71500]: WARNING nova.compute.manager [req-17d9a625-9054-4d28-b080-07491f70c540 req-973d96db-1d3c-421a-a570-0d2995779c53 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state active and task_state rescuing.
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f --force-share --output=json" returned: 0 in 0.152s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f,backing_fmt=raw /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f,backing_fmt=raw /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue" returned: 0 in 0.053s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f1ac2641e3e032590530f4a725101bd73513746f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'migration_context' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Start _get_guest_xml network_info=[{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "vif_mac": "fa:16:3e:88:f7:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8aae4aad-6003-4434-bde0-93ff7ad3d2b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '479707a0-97b2-47e8-adb0-c9566985bfbc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3', 'attached_at': '', 'detached_at': '', 'volume_id': '34a8d836-37e0-4250-9c77-0bec8d481ee4', 'serial': '34a8d836-37e0-4250-9c77-0bec8d481ee4'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'resources' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'numa_topology' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:21 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:42:21 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'vcpu_model' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:42:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:42:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:42:21 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6ad24-fada-4435-b32d-c86102c1aa46]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = bEOCaKTZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 15:42:21 user nova-compute[71500]: node.name = iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:42:21 user nova-compute[71500]: node.tpgt = -1
Apr 14 15:42:21 user nova-compute[71500]: node.startup = automatic
Apr 14 15:42:21 user nova-compute[71500]: node.leading_login = No
Apr 14 15:42:21 user nova-compute[71500]: iface.iscsi_ifacename = default
Apr 14 15:42:21 user nova-compute[71500]: iface.net_ifacename = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.ipaddress = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.prefix_len = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.hwaddress = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.transport_name = tcp
Apr 14 15:42:21 user nova-compute[71500]: iface.initiatorname = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.vlan_id = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.vlan_priority = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.vlan_state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.iface_num = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.mtu = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.port = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.bootproto = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.subnet_mask = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.gateway = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_alt_client_id = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_dns = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_learn_iqn = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_vendor_id_state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_vendor_id = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.dhcp_slp_da = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.fragmentation = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.gratuitous_arp = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.incoming_forwarding = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.tos_state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.tos = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.ttl = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.delayed_ack = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.tcp_nagle = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.tcp_wsf_state = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.tcp_wsf = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.tcp_timer_scale = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.tcp_timestamp = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.redirect = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.def_task_mgmt_timeout = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.header_digest = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.data_digest = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.immediate_data = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.initial_r2t = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.data_seq_inorder = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.data_pdu_inorder = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.erl = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.max_receive_data_len = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.first_burst_len = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.max_outstanding_r2t = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.max_burst_len = 0
Apr 14 15:42:21 user nova-compute[71500]: iface.chap_auth = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.bidi_chap = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.strict_login_compliance = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.discovery_auth = <empty>
Apr 14 15:42:21 user nova-compute[71500]: iface.discovery_logout = <empty>
Apr 14 15:42:21 user nova-compute[71500]: node.discovery_address = <empty>
Apr 14 15:42:21 user nova-compute[71500]: node.discovery_port = 0
Apr 14 15:42:21 user nova-compute[71500]: node.discovery_type = static
Apr 14 15:42:21 user nova-compute[71500]: node.session.initial_cmdsn = 0
Apr 14 15:42:21 user nova-compute[71500]: node.session.initial_login_retry_max = 8
Apr 14 15:42:21 user nova-compute[71500]: node.session.xmit_thread_priority = -20
Apr 14 15:42:21 user nova-compute[71500]: node.session.cmds_max = 128
Apr 14 15:42:21 user nova-compute[71500]: node.session.queue_depth = 32
Apr 14 15:42:21 user nova-compute[71500]: node.session.nr_sessions = 1
Apr 14 15:42:21 user nova-compute[71500]: node.session.auth.authmethod = CHAP
Apr 14 15:42:21 user nova-compute[71500]: node.session.auth.username = bEOCaKTZ
Apr 14 15:42:21 user nova-compute[71500]: node.session.auth.password = ***
Apr 14 15:42:21 user nova-compute[71500]: node.session.auth.username_in = <empty>
Apr 14 15:42:21 user nova-compute[71500]: node.session.auth.password_in = <empty>
Apr 14 15:42:21 user nova-compute[71500]: node.session.auth.chap_algs = MD5
Apr 14 15:42:21 user nova-compute[71500]: node.session.timeo.replacement_timeout = 120
Apr 14 15:42:21 user nova-compute[71500]: node.session.err_timeo.abort_timeout = 15
Apr 14 15:42:21 user nova-compute[71500]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 15:42:21 user nova-compute[71500]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 15:42:21 user nova-compute[71500]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.FastAbort = Yes
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.InitialR2T = No
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.ImmediateData = Yes
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.MaxConnections = 1
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 15:42:21 user nova-compute[71500]: node.session.iscsi.ERL = 0
Apr 14 15:42:21 user nova-compute[71500]: node.session.scan = manual
Apr 14 15:42:21 user nova-compute[71500]: node.session.reopen_max = 0
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].address = 172.16.0.220
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].port = 3260
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].startup = manual
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].tcp.window_size = 524288
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].tcp.type_of_service = 0
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].timeo.logout_timeout = 15
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].timeo.login_timeout = 15
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].timeo.auth_timeout = 45
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].iscsi.DataDigest = None
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].iscsi.IFMarker = No
Apr 14 15:42:21 user nova-compute[71500]: node.conn[0].iscsi.OFMarker = No
Apr 14 15:42:21 user nova-compute[71500]: # END RECORD
Apr 14 15:42:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6859cb-f96a-41de-807f-d4c8fbd92aac]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2bfef-2727-4f1e-8152-7c336259f032]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEOCaKTZ {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bEOCaKTZ" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[68101bee-d0e7-477b-8557-0cc03265acbe]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bEOCaKTZ'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[129a1acd-5058-49fc-918a-0d28651c37a4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[60072e8c-ec9d-4692-8d85-5ec56efdb172]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:42:21 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:42:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:42:21 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:42:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d11551-4647-4921-938f-015d30bfcef2]: (4, ('0 0 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23863373366393234', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863373366393234', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-323856204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-323856204',id=16,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:40:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-3bxuxzha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:40:46Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "vif_mac": "fa:16:3e:88:f7:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "vif_mac": "fa:16:3e:88:f7:a1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'pci_devices' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:42:21 user nova-compute[71500]:   <uuid>e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3</uuid>
Apr 14 15:42:21 user nova-compute[71500]:   <name>instance-00000010</name>
Apr 14 15:42:21 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:42:21 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:42:21 user nova-compute[71500]:   <metadata>
Apr 14 15:42:21 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:42:21 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:42:21 user nova-compute[71500]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-323856204</nova:name>
Apr 14 15:42:21 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:42:21</nova:creationTime>
Apr 14 15:42:21 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:42:21 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:42:21 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:42:21 user nova-compute[71500]:       <nova:owner>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:user uuid="efb645d110464e7e85d7c955ee9f3466">tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member</nova:user>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:project uuid="584a53650c014f87b9622f2011996200">tempest-ServerBootFromVolumeStableRescueTest-756745587</nova:project>
Apr 14 15:42:21 user nova-compute[71500]:       </nova:owner>
Apr 14 15:42:21 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:42:21 user nova-compute[71500]:       <nova:ports>
Apr 14 15:42:21 user nova-compute[71500]:         <nova:port uuid="18973ac2-c226-4d12-98e7-5bbee348527a">
Apr 14 15:42:21 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 15:42:21 user nova-compute[71500]:         </nova:port>
Apr 14 15:42:21 user nova-compute[71500]:       </nova:ports>
Apr 14 15:42:21 user nova-compute[71500]:     </nova:instance>
Apr 14 15:42:21 user nova-compute[71500]:   </metadata>
Apr 14 15:42:21 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:42:21 user nova-compute[71500]:     <system>
Apr 14 15:42:21 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:42:21 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:42:21 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:42:21 user nova-compute[71500]:       <entry name="serial">e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3</entry>
Apr 14 15:42:21 user nova-compute[71500]:       <entry name="uuid">e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3</entry>
Apr 14 15:42:21 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:42:21 user nova-compute[71500]:     </system>
Apr 14 15:42:21 user nova-compute[71500]:   </sysinfo>
Apr 14 15:42:21 user nova-compute[71500]:   <os>
Apr 14 15:42:21 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:42:21 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:42:21 user nova-compute[71500]:   </os>
Apr 14 15:42:21 user nova-compute[71500]:   <features>
Apr 14 15:42:21 user nova-compute[71500]:     <acpi/>
Apr 14 15:42:21 user nova-compute[71500]:     <apic/>
Apr 14 15:42:21 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:42:21 user nova-compute[71500]:   </features>
Apr 14 15:42:21 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:42:21 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:42:21 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:42:21 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:42:21 user nova-compute[71500]:   </clock>
Apr 14 15:42:21 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:42:21 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:42:21 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:42:21 user nova-compute[71500]:   </cpu>
Apr 14 15:42:21 user nova-compute[71500]:   <devices>
Apr 14 15:42:21 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:42:21 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:42:21 user nova-compute[71500]:       <source dev="/dev/sdc"/>
Apr 14 15:42:21 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:42:21 user nova-compute[71500]:       <serial>34a8d836-37e0-4250-9c77-0bec8d481ee4</serial>
Apr 14 15:42:21 user nova-compute[71500]:     </disk>
Apr 14 15:42:21 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:42:21 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:42:21 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue"/>
Apr 14 15:42:21 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:42:21 user nova-compute[71500]:       <boot order="1"/>
Apr 14 15:42:21 user nova-compute[71500]:     </disk>
Apr 14 15:42:21 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:42:21 user nova-compute[71500]:       <mac address="fa:16:3e:88:f7:a1"/>
Apr 14 15:42:21 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:42:21 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:42:21 user nova-compute[71500]:       <target dev="tap18973ac2-c2"/>
Apr 14 15:42:21 user nova-compute[71500]:     </interface>
Apr 14 15:42:21 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:42:21 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/console.log" append="off"/>
Apr 14 15:42:21 user nova-compute[71500]:     </serial>
Apr 14 15:42:21 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:42:21 user nova-compute[71500]:     <video>
Apr 14 15:42:21 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:42:21 user nova-compute[71500]:     </video>
Apr 14 15:42:21 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:42:21 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:42:21 user nova-compute[71500]:     </rng>
Apr 14 15:42:21 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:42:21 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:42:21 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:42:21 user nova-compute[71500]:     </memballoon>
Apr 14 15:42:21 user nova-compute[71500]:   </devices>
Apr 14 15:42:21 user nova-compute[71500]: </domain>
Apr 14 15:42:21 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:42:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance destroyed successfully.
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:42:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No VIF found with MAC fa:16:3e:88:f7:a1, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:42:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:23 user nova-compute[71500]: WARNING nova.compute.manager [req-a85e082f-5ec4-4aef-96b1-3ab8724aca8f req-6d818a50-7b08-41a3-8c61-9d56caf79c90 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state active and task_state rescuing.
Apr 14 15:42:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486945.4383445, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:42:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Resumed (Lifecycle Event)
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-eea3081c-6968-4b3f-b2b3-25284a29d08a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:42:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486945.4433532, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:42:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Started (Lifecycle Event)
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:42:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:25 user nova-compute[71500]: WARNING nova.compute.manager [req-ad4f7ba3-3602-4bdd-ac5b-77825e7849a3 req-f2240585-8bc0-43f2-a1cb-2794b62b426a service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state None.
Apr 14 15:42:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 15:42:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 15:42:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:34 user nova-compute[71500]: INFO nova.compute.manager [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Unrescuing
Apr 14 15:42:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:42:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:42:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.network.neutron [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.objects.instance [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'flavor' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:36 user nova-compute[71500]: WARNING nova.compute.manager [req-52dca0b2-66f6-4633-86d9-8cf7cafeb94f req-b87f12fe-dac9-4c33-88a9-1392cc78608f service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing instance network info cache due to event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:42:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:42:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance destroyed successfully.
Apr 14 15:42:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updated VIF entry in instance network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fc6d6967-30a7-4523-b02b-583422054988 req-e4e6fd83-8f78-4f7d-b693-e59278f8ff13 service nova] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:38 user nova-compute[71500]: WARNING nova.compute.manager [req-144b0e53-2d7a-4c8d-9ef8-88e2943cc443 req-419a2ef8-c915-4acc-97f4-e47b5b6637d4 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:42:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing instance network info cache due to event network-changed-cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Acquiring lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Acquired lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Refreshing network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:42:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updated VIF entry in instance network info cache for port cfb03b4e-c244-4ebd-bff5-7e250ac32044. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [{"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1b62ab21-9ad2-4235-9809-2f63da1fbd81 req-28f83424-2309-42dd-a30f-69f5e162c34a service nova] Releasing lock "refresh_cache-2d91a139-cb0c-40c1-99a1-6b34dcb60bed" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:40 user nova-compute[71500]: WARNING nova.compute.manager [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:42:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:40 user nova-compute[71500]: WARNING nova.compute.manager [req-d7d1e64c-4328-465a-9d29-05d8707a3499 req-1f88d8ce-383a-4829-b070-af0877770047 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-46849743-4d8c-4f8a-b658-577795c94efa tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 2d91a139-cb0c-40c1-99a1-6b34dcb60bed due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486961.2423682, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:42:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Resumed (Lifecycle Event)
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486961.243131, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:42:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Started (Lifecycle Event)
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:42:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:42:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:43 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:42:43 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:42:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7745MB free_disk=26.122913360595703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:42:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f094302b-0730-4754-b9e9-ec203312b8c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d7088d6e-b443-4c76-8a13-199e0721ea36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:42:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.113s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-changed-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Refreshing instance network info cache due to event network-changed-f5a1caf6-baf3-4c27-82c9-aab287c07447. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:42:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:42:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:42:45 user nova-compute[71500]: DEBUG nova.network.neutron [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Refreshing network info cache for port f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:42:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updated VIF entry in instance network info cache for port f5a1caf6-baf3-4c27-82c9-aab287c07447. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:42:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:42:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2901240b-be65-4e4d-9f29-cb98598512fc req-57380d37-8f6e-4be4-aa0f-051b0bef04b1 service nova] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:42:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:56 user nova-compute[71500]: INFO nova.compute.manager [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Terminating instance
Apr 14 15:42:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-vif-unplugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] No waiting events found dispatching network-vif-unplugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-5d6f91a6-8051-4898-9d24-d10695b5a5bf req-9810762c-c8b7-4d8a-9a98-50772da2cd02 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-vif-unplugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:42:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Instance destroyed successfully.
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.objects.instance [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lazy-loading 'resources' on Instance uuid f094302b-0730-4754-b9e9-ec203312b8c0 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:37:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-487888847',display_name='tempest-VolumesAdminNegativeTest-server-487888847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-487888847',id=7,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVb9qsJSLS3Bgfyq6KylCGL6p6wxpntlLqZCZt1R/qL08QarxPv7eu4MozJC3l12xLn6LGwBQgTP4zKdsaYGDeB2GiKSBHU5x054fe5UNG2NcO4opY99adqDnprJnJRQ==',key_name='tempest-keypair-1028605759',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:37:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='029b8c395f264a86933a9e878c18e0b2',ramdisk_id='',reservation_id='r-jfhcko96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1127532',owner_user_name='tempest-VolumesAdminNegativeTest-1127532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1aa921f86bd4f3b88eb782d5f667816',uuid=f094302b-0730-4754-b9e9-ec203312b8c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converting VIF {"id": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "address": "fa:16:3e:68:eb:21", "network": {"id": "f640a309-f997-4ae7-8c15-cd2a0e846ca4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401946139-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "029b8c395f264a86933a9e878c18e0b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap674fa5df-38", "ovs_interfaceid": "674fa5df-38fc-4d44-9f38-fbae08c80e81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG os_vif [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap674fa5df-38, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:57 user nova-compute[71500]: INFO os_vif [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:eb:21,bridge_name='br-int',has_traffic_filtering=True,id=674fa5df-38fc-4d44-9f38-fbae08c80e81,network=Network(f640a309-f997-4ae7-8c15-cd2a0e846ca4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap674fa5df-38')
Apr 14 15:42:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Deleting instance files /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0_del
Apr 14 15:42:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Deletion of /opt/stack/data/nova/instances/f094302b-0730-4754-b9e9-ec203312b8c0_del complete
Apr 14 15:42:57 user nova-compute[71500]: INFO nova.compute.manager [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Took 1.35 seconds to destroy the instance on the hypervisor.
Apr 14 15:42:57 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:42:57 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:42:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:42:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:42:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Acquiring lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:42:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:42:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] Lock "f094302b-0730-4754-b9e9-ec203312b8c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:42:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] No waiting events found dispatching network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:42:59 user nova-compute[71500]: WARNING nova.compute.manager [req-048cd7e3-9d8c-46f7-a1e3-82068f14a144 req-94ae9f04-acef-41e4-bdc6-f793679663b9 service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received unexpected event network-vif-plugged-674fa5df-38fc-4d44-9f38-fbae08c80e81 for instance with vm_state active and task_state deleting.
Apr 14 15:43:00 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:00 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Took 2.39 seconds to deallocate network for instance.
Apr 14 15:43:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:00 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:43:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:43:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:00 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Deleted allocations for instance f094302b-0730-4754-b9e9-ec203312b8c0
Apr 14 15:43:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a88b49d5-f233-4d74-a2d8-9f55444698b8 tempest-VolumesAdminNegativeTest-1127532 tempest-VolumesAdminNegativeTest-1127532-project-member] Lock "f094302b-0730-4754-b9e9-ec203312b8c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.327s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-7ff87237-ab1f-42ce-910c-9230dc737262 req-b6e13c72-9524-44ed-89be-1ac9d97c9ecd service nova] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Received event network-vif-deleted-674fa5df-38fc-4d44-9f38-fbae08c80e81 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:43:08 user nova-compute[71500]: INFO nova.compute.claims [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Claim successful on node user
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:08 user nova-compute[71500]: INFO nova.compute.manager [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Detaching volume 2f60c4f2-a281-469b-9c0e-cf96631f965c
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:43:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:43:08 user nova-compute[71500]: INFO nova.virt.block_device [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Attempting to driver detach volume 2f60c4f2-a281-469b-9c0e-cf96631f965c from mountpoint /dev/vdb
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Attempting to detach device vdb from instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:43:08 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:43:08 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:43:08 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:43:08 user nova-compute[71500]:   <serial>2f60c4f2-a281-469b-9c0e-cf96631f965c</serial>
Apr 14 15:43:08 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:43:08 user nova-compute[71500]: </disk>
Apr 14 15:43:08 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:43:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Successfully detached device vdb from instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed from the persistent domain config.
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:43:08 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:43:08 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:43:08 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:43:08 user nova-compute[71500]:   <serial>2f60c4f2-a281-469b-9c0e-cf96631f965c</serial>
Apr 14 15:43:08 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:43:08 user nova-compute[71500]: </disk>
Apr 14 15:43:08 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.policy [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ee063f686de4a9f9e6b5fe1e7ce2c3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '737ea257ab5448389bd751841be0fc72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:43:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Creating image(s)
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "/opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "/opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681486989.0387604, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:43:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Successfully detached device vdb from instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed from the live domain config.
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk 1073741824" returned: 0 in 0.052s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApwjImHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:43:09 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef49414-64ab-47fc-bdd4-4fd5aaaf12e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:43:09 user nova-compute[71500]: No targets found.
Apr 14 15:43:09 user nova-compute[71500]: iSNS:
Apr 14 15:43:09 user nova-compute[71500]: No targets found.
Apr 14 15:43:09 user nova-compute[71500]: STATIC:
Apr 14 15:43:09 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:43:09 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:43:09 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:43:09 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c
Apr 14 15:43:09 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:43:09 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:43:09 user nova-compute[71500]: FIRMWARE:
Apr 14 15:43:09 user nova-compute[71500]: No targets found.
Apr 14 15:43:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:43:09 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:43:09 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec14ac-d8f2-43ea-8f80-62937b7a8407]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a25442-d26c-40bf-af75-ee56c254301f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:43:09 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c (non-flash)
Apr 14 15:43:09 user nova-compute[71500]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc7eb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[11577496-2e15-4863-b532-9749cbf10905]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2911c2dc-29a6-4951-b72a-1b63448cc3d9]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.187s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e552e095-51a4-4d74-8207-3f1ff5f194c2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a377af-bb41-4923-9bbe-0e7e16f7479b]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5337d3-602f-41ed-a931-2d03ef5ce06d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Cannot resize image /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'migration_context' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Ensure instance console log exists: /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --logout" returned: 0 in 0.132s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baeddf6-649f-412d-a15a-3793fc18d60e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260]
Apr 14 15:43:09 user nova-compute[71500]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c, portal: 172.16.0.220,3260] successful.
Apr 14 15:43:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Successfully created port: 3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f60c4f2-a281-469b-9c0e-cf96631f965c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[86801714-2abe-4bcd-9a92-cd356531f66f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] <== disconnect_volume: return (428ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:43:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Successfully updated port: 3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquired lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-changed-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Refreshing instance network info cache due to event network-changed-3f7d69ad-aaff-498b-8862-241238c91a38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Acquiring lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'flavor' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f72bd3b0-873e-4e9a-9ab3-54c6c0f2a96d tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.958s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating instance_info_cache with network_info: [{"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Releasing lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Instance network_info: |[{"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Acquired lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Refreshing network info cache for port 3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Start _get_guest_xml network_info=[{"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:43:10 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:10 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1933872661',display_name='tempest-SnapshotDataIntegrityTests-server-1933872661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1933872661',id=19,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFha8odW+z7ISDIuPdSZePdAynxjWLOIGWY2I6lL7a2QwhfFIdZm7ObXMS8bvQTWc0DBFIrcJxz8DhdLKuke9J8N3t2DQvcIs9S9uYys2p7+hpLefYLxHN59XZ9twQcsw==',key_name='tempest-SnapshotDataIntegrityTests-2098361315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='737ea257ab5448389bd751841be0fc72',ramdisk_id='',reservation_id='r-huo57pwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1698287900',owner_user_name='tempest-SnapshotDataIntegrityTests-1698287900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:43:09Z,user_data=None,user_id='4ee063f686de4a9f9e6b5fe1e7ce2c3a',uuid=cc81318c-1157-4832-919a-28cc14431f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Converting VIF {"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'pci_devices' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:43:10 user nova-compute[71500]:   <uuid>cc81318c-1157-4832-919a-28cc14431f48</uuid>
Apr 14 15:43:10 user nova-compute[71500]:   <name>instance-00000013</name>
Apr 14 15:43:10 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:43:10 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:43:10 user nova-compute[71500]:   <metadata>
Apr 14 15:43:10 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:43:10 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:43:10 user nova-compute[71500]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1933872661</nova:name>
Apr 14 15:43:10 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:43:10</nova:creationTime>
Apr 14 15:43:10 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:43:10 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:43:10 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:43:10 user nova-compute[71500]:       <nova:owner>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:user uuid="4ee063f686de4a9f9e6b5fe1e7ce2c3a">tempest-SnapshotDataIntegrityTests-1698287900-project-member</nova:user>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:project uuid="737ea257ab5448389bd751841be0fc72">tempest-SnapshotDataIntegrityTests-1698287900</nova:project>
Apr 14 15:43:10 user nova-compute[71500]:       </nova:owner>
Apr 14 15:43:10 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:43:10 user nova-compute[71500]:       <nova:ports>
Apr 14 15:43:10 user nova-compute[71500]:         <nova:port uuid="3f7d69ad-aaff-498b-8862-241238c91a38">
Apr 14 15:43:10 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 15:43:10 user nova-compute[71500]:         </nova:port>
Apr 14 15:43:10 user nova-compute[71500]:       </nova:ports>
Apr 14 15:43:10 user nova-compute[71500]:     </nova:instance>
Apr 14 15:43:10 user nova-compute[71500]:   </metadata>
Apr 14 15:43:10 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:43:10 user nova-compute[71500]:     <system>
Apr 14 15:43:10 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:43:10 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:43:10 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:43:10 user nova-compute[71500]:       <entry name="serial">cc81318c-1157-4832-919a-28cc14431f48</entry>
Apr 14 15:43:10 user nova-compute[71500]:       <entry name="uuid">cc81318c-1157-4832-919a-28cc14431f48</entry>
Apr 14 15:43:10 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:43:10 user nova-compute[71500]:     </system>
Apr 14 15:43:10 user nova-compute[71500]:   </sysinfo>
Apr 14 15:43:10 user nova-compute[71500]:   <os>
Apr 14 15:43:10 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:43:10 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:43:10 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:43:10 user nova-compute[71500]:   </os>
Apr 14 15:43:10 user nova-compute[71500]:   <features>
Apr 14 15:43:10 user nova-compute[71500]:     <acpi/>
Apr 14 15:43:10 user nova-compute[71500]:     <apic/>
Apr 14 15:43:10 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:43:10 user nova-compute[71500]:   </features>
Apr 14 15:43:10 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:43:10 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:43:10 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:43:10 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:43:10 user nova-compute[71500]:   </clock>
Apr 14 15:43:10 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:43:10 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:43:10 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:43:10 user nova-compute[71500]:   </cpu>
Apr 14 15:43:10 user nova-compute[71500]:   <devices>
Apr 14 15:43:10 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:43:10 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:43:10 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk"/>
Apr 14 15:43:10 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:43:10 user nova-compute[71500]:     </disk>
Apr 14 15:43:10 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:43:10 user nova-compute[71500]:       <mac address="fa:16:3e:c3:bc:4d"/>
Apr 14 15:43:10 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:43:10 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:43:10 user nova-compute[71500]:       <target dev="tap3f7d69ad-aa"/>
Apr 14 15:43:10 user nova-compute[71500]:     </interface>
Apr 14 15:43:10 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:43:10 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/console.log" append="off"/>
Apr 14 15:43:10 user nova-compute[71500]:     </serial>
Apr 14 15:43:10 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:43:10 user nova-compute[71500]:     <video>
Apr 14 15:43:10 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:43:10 user nova-compute[71500]:     </video>
Apr 14 15:43:10 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:43:10 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:43:10 user nova-compute[71500]:     </rng>
Apr 14 15:43:10 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:43:10 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:43:10 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:43:10 user nova-compute[71500]:     </memballoon>
Apr 14 15:43:10 user nova-compute[71500]:   </devices>
Apr 14 15:43:10 user nova-compute[71500]: </domain>
Apr 14 15:43:10 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1933872661',display_name='tempest-SnapshotDataIntegrityTests-server-1933872661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1933872661',id=19,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFha8odW+z7ISDIuPdSZePdAynxjWLOIGWY2I6lL7a2QwhfFIdZm7ObXMS8bvQTWc0DBFIrcJxz8DhdLKuke9J8N3t2DQvcIs9S9uYys2p7+hpLefYLxHN59XZ9twQcsw==',key_name='tempest-SnapshotDataIntegrityTests-2098361315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='737ea257ab5448389bd751841be0fc72',ramdisk_id='',reservation_id='r-huo57pwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1698287900',owner_user_name='tempest-SnapshotDataIntegrityTests-1698287900-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:43:09Z,user_data=None,user_id='4ee063f686de4a9f9e6b5fe1e7ce2c3a',uuid=cc81318c-1157-4832-919a-28cc14431f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Converting VIF {"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG os_vif [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f7d69ad-aa, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f7d69ad-aa, col_values=(('external_ids', {'iface-id': '3f7d69ad-aaff-498b-8862-241238c91a38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:bc:4d', 'vm-uuid': 'cc81318c-1157-4832-919a-28cc14431f48'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:43:10 user nova-compute[71500]: INFO os_vif [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa')
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:43:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No VIF found with MAC fa:16:3e:c3:bc:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:43:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updated VIF entry in instance network info cache for port 3f7d69ad-aaff-498b-8862-241238c91a38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:43:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating instance_info_cache with network_info: [{"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-704c3916-2870-460e-b7ce-4b8a9dc219cc req-b8a4f63a-4b2d-4dc4-8f91-ec2e89eda4ed service nova] Releasing lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681486977.452616, f094302b-0730-4754-b9e9-ec203312b8c0 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:12 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] VM Stopped (Lifecycle Event)
Apr 14 15:43:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8d42fe89-4bd1-4cc7-a112-197cbaa99955 None None] [instance: f094302b-0730-4754-b9e9-ec203312b8c0] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] No waiting events found dispatching network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:12 user nova-compute[71500]: WARNING nova.compute.manager [req-6adf55f3-a3c3-46c7-b933-bdeb8831c73b req-854df07d-7469-47cb-98df-395c575ab703 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received unexpected event network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 for instance with vm_state building and task_state spawning.
Apr 14 15:43:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486994.6514513, cc81318c-1157-4832-919a-28cc14431f48 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] VM Resumed (Lifecycle Event)
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] Instance spawned successfully.
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681486994.652465, cc81318c-1157-4832-919a-28cc14431f48 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] VM Started (Lifecycle Event)
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Took 6.03 seconds to spawn the instance on the hypervisor.
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:14 user nova-compute[71500]: INFO nova.compute.manager [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Took 6.86 seconds to build instance.
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] No waiting events found dispatching network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:14 user nova-compute[71500]: WARNING nova.compute.manager [req-85fcf12d-8ec8-4058-877f-484e13e2b8d4 req-abb31d74-9b72-482a-bef8-189e68ea58d1 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received unexpected event network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 for instance with vm_state active and task_state None.
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8e03cd35-eab1-4011-a0ab-c3df9961e613 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.982s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 0339b7d6-294b-4669-9782-51de5748226a {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid d8e21d6b-fc8f-4373-a54f-452ab5fa169c {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0339b7d6-294b-4669-9782-51de5748226a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0339b7d6-294b-4669-9782-51de5748226a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:43:17 user nova-compute[71500]: INFO nova.compute.claims [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Claim successful on node user
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:43:17 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:43:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.policy [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:43:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Creating image(s)
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "/opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "/opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "/opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk 1073741824" returned: 0 in 0.056s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Checking if we can resize image /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Cannot resize image /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'migration_context' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Successfully created port: 59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Ensure instance console log exists: /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Successfully updated port: 59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquired lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-changed-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Refreshing instance network info cache due to event network-changed-59970400-49c0-4153-85a7-7b9b9496df26. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Acquiring lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updating instance_info_cache with network_info: [{"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Releasing lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Instance network_info: |[{"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Acquired lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Refreshing network info cache for port 59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Start _get_guest_xml network_info=[{"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:43:20 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:20 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-915600654',display_name='tempest-TestStampPattern-server-915600654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-915600654',id=20,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q==',key_name='tempest-TestStampPattern-1517680664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1ac7fb012e144cdaa7da36ee9b590a0',ramdisk_id='',reservation_id='r-b7zl1qod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2099461179',owner_user_name='tempest-TestStampPattern-2099461179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:43:18Z,user_data=None,user_id='855c585696694964974a8df948ab7899',uuid=203e4039-aa71-4521-8e74-02452436cb60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converting VIF {"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'pci_devices' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:43:20 user nova-compute[71500]:   <uuid>203e4039-aa71-4521-8e74-02452436cb60</uuid>
Apr 14 15:43:20 user nova-compute[71500]:   <name>instance-00000014</name>
Apr 14 15:43:20 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:43:20 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:43:20 user nova-compute[71500]:   <metadata>
Apr 14 15:43:20 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:43:20 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:43:20 user nova-compute[71500]:       <nova:name>tempest-TestStampPattern-server-915600654</nova:name>
Apr 14 15:43:20 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:43:20</nova:creationTime>
Apr 14 15:43:20 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:43:20 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:43:20 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:43:20 user nova-compute[71500]:       <nova:owner>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:user uuid="855c585696694964974a8df948ab7899">tempest-TestStampPattern-2099461179-project-member</nova:user>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:project uuid="d1ac7fb012e144cdaa7da36ee9b590a0">tempest-TestStampPattern-2099461179</nova:project>
Apr 14 15:43:20 user nova-compute[71500]:       </nova:owner>
Apr 14 15:43:20 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:43:20 user nova-compute[71500]:       <nova:ports>
Apr 14 15:43:20 user nova-compute[71500]:         <nova:port uuid="59970400-49c0-4153-85a7-7b9b9496df26">
Apr 14 15:43:20 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:43:20 user nova-compute[71500]:         </nova:port>
Apr 14 15:43:20 user nova-compute[71500]:       </nova:ports>
Apr 14 15:43:20 user nova-compute[71500]:     </nova:instance>
Apr 14 15:43:20 user nova-compute[71500]:   </metadata>
Apr 14 15:43:20 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:43:20 user nova-compute[71500]:     <system>
Apr 14 15:43:20 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:43:20 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:43:20 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:43:20 user nova-compute[71500]:       <entry name="serial">203e4039-aa71-4521-8e74-02452436cb60</entry>
Apr 14 15:43:20 user nova-compute[71500]:       <entry name="uuid">203e4039-aa71-4521-8e74-02452436cb60</entry>
Apr 14 15:43:20 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:43:20 user nova-compute[71500]:     </system>
Apr 14 15:43:20 user nova-compute[71500]:   </sysinfo>
Apr 14 15:43:20 user nova-compute[71500]:   <os>
Apr 14 15:43:20 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:43:20 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:43:20 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:43:20 user nova-compute[71500]:   </os>
Apr 14 15:43:20 user nova-compute[71500]:   <features>
Apr 14 15:43:20 user nova-compute[71500]:     <acpi/>
Apr 14 15:43:20 user nova-compute[71500]:     <apic/>
Apr 14 15:43:20 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:43:20 user nova-compute[71500]:   </features>
Apr 14 15:43:20 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:43:20 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:43:20 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:43:20 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:43:20 user nova-compute[71500]:   </clock>
Apr 14 15:43:20 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:43:20 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:43:20 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:43:20 user nova-compute[71500]:   </cpu>
Apr 14 15:43:20 user nova-compute[71500]:   <devices>
Apr 14 15:43:20 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:43:20 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:43:20 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk"/>
Apr 14 15:43:20 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:43:20 user nova-compute[71500]:     </disk>
Apr 14 15:43:20 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:43:20 user nova-compute[71500]:       <mac address="fa:16:3e:99:65:56"/>
Apr 14 15:43:20 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:43:20 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:43:20 user nova-compute[71500]:       <target dev="tap59970400-49"/>
Apr 14 15:43:20 user nova-compute[71500]:     </interface>
Apr 14 15:43:20 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:43:20 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/console.log" append="off"/>
Apr 14 15:43:20 user nova-compute[71500]:     </serial>
Apr 14 15:43:20 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:43:20 user nova-compute[71500]:     <video>
Apr 14 15:43:20 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:43:20 user nova-compute[71500]:     </video>
Apr 14 15:43:20 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:43:20 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:43:20 user nova-compute[71500]:     </rng>
Apr 14 15:43:20 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:43:20 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:43:20 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:43:20 user nova-compute[71500]:     </memballoon>
Apr 14 15:43:20 user nova-compute[71500]:   </devices>
Apr 14 15:43:20 user nova-compute[71500]: </domain>
Apr 14 15:43:20 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-915600654',display_name='tempest-TestStampPattern-server-915600654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-915600654',id=20,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q==',key_name='tempest-TestStampPattern-1517680664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1ac7fb012e144cdaa7da36ee9b590a0',ramdisk_id='',reservation_id='r-b7zl1qod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2099461179',owner_user_name='tempest-TestStampPattern-2099461179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:43:18Z,user_data=None,user_id='855c585696694964974a8df948ab7899',uuid=203e4039-aa71-4521-8e74-02452436cb60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converting VIF {"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG os_vif [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59970400-49, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59970400-49, col_values=(('external_ids', {'iface-id': '59970400-49c0-4153-85a7-7b9b9496df26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:65:56', 'vm-uuid': '203e4039-aa71-4521-8e74-02452436cb60'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:20 user nova-compute[71500]: INFO os_vif [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49')
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No VIF found with MAC fa:16:3e:99:65:56, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updated VIF entry in instance network info cache for port 59970400-49c0-4153-85a7-7b9b9496df26. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updating instance_info_cache with network_info: [{"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-19c2c7a4-40f6-45da-9ed3-9ccaf8574d72 req-77c54fff-9ffb-4ebb-a80a-79ce493bd957 service nova] Releasing lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] No waiting events found dispatching network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:21 user nova-compute[71500]: WARNING nova.compute.manager [req-f250a4c0-95f5-45e7-ada1-4fcc6402327a req-a47d8d75-f848-4973-9e33-5ff9db560b76 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received unexpected event network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 for instance with vm_state building and task_state spawning.
Apr 14 15:43:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:23 user nova-compute[71500]: INFO nova.compute.manager [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Unrescuing
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:23 user nova-compute[71500]: WARNING nova.compute.manager [req-0c058b6f-21e6-489d-a78b-ae431bcdc78f req-0b2f118c-cd20-4658-b2c1-80e0a71b233e service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487003.9046938, 203e4039-aa71-4521-8e74-02452436cb60 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] VM Resumed (Lifecycle Event)
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Instance spawned successfully.
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] No waiting events found dispatching network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:23 user nova-compute[71500]: WARNING nova.compute.manager [req-cb0f4f14-b165-4034-a4e6-7b95f918aead req-fcac4262-1175-433b-bf17-d6891052f4c8 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received unexpected event network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 for instance with vm_state building and task_state spawning.
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:43:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:43:23 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487003.9050164, 203e4039-aa71-4521-8e74-02452436cb60 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] VM Started (Lifecycle Event)
Apr 14 15:43:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:24 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:43:24 user nova-compute[71500]: INFO nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 14 15:43:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:24 user nova-compute[71500]: INFO nova.compute.manager [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Took 6.86 seconds to build instance.
Apr 14 15:43:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance destroyed successfully.
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9d251004-447a-4d10-8eb4-f521e803e212 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.957s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'flavor' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:24 user nova-compute[71500]: INFO nova.compute.manager [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Attaching volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 to /dev/vdb
Apr 14 15:43:24 user nova-compute[71500]: DEBUG os_brick.utils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[80246503-1ef6-4b18-9e50-4596ff781133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c637c058-5ec8-458a-87b9-74cff86d2956]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b19a8-f70a-4769-ae83-7dead3a2fc58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c7b209-aefd-410b-af4a-91f32ab30c36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:43:24 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:43:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[821de1a1-341b-4f18-8908-95429d85619e]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG os_brick.utils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:43:24 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating existing volume attachment record: 02b28fe2-7d15-492f-bab5-a06151cb3126 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:25 user nova-compute[71500]: WARNING nova.compute.manager [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:43:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:25 user nova-compute[71500]: WARNING nova.compute.manager [req-c806af63-b0f2-4c7c-a882-f06d88f2c76f req-4f6c99a5-e1b9-408b-8876-ba73db8096a1 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 0f27f459-5b11-4564-ab4c-7194b18319f4 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487007.8533273, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Resumed (Lifecycle Event)
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-786c7dde-d60a-4cdc-9c8b-1ed0c0003f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487007.8553505, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Started (Lifecycle Event)
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:28 user nova-compute[71500]: WARNING nova.compute.manager [req-6c944ccb-2b48-4880-b8ee-c4966a16ff55 req-289e4df6-66c4-4421-8dc3-46d71571ada5 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state active and task_state None.
Apr 14 15:43:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:43:29 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:43:29 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:43:29 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[32205796-cdee-43e0-b870-bd710701b1d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:43:29 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5475a7a-b71a-4df0-b5fb-a4a40865e2b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305] added
Apr 14 15:43:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d3a12d-c828-49bb-aa9f-442151230687]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[931c7d93-1d9c-4921-a17a-ed3065b135a9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylZPvqnB {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylZPvqnB" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f16a797-faaf-419c-beac-5d7d5ccddae8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylZPvqnB'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fd8548-357c-4de8-8cce-f8e440fe8bf6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eb043d-9ae3-495f-84e2-a280f0788e44]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb48df-cc2f-435b-bb65-78791df0dff3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]
Apr 14 15:43:29 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.
Apr 14 15:43:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f49e0d-aed9-425c-a305-09eee705929e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b84359d-efa1-442b-b617-81b1560cf802]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:29 user nova-compute[71500]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:43:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:29 user nova-compute[71500]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:43:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c6b291-50c4-4271-abf3-0154d39c9d55]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23866303139656135', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866303139656135', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'flavor' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:43:30 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:43:30 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:43:30 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:43:30 user nova-compute[71500]:   <serial>25aefab3-a41b-41a7-bc7c-4f07017f7305</serial>
Apr 14 15:43:30 user nova-compute[71500]: </disk>
Apr 14 15:43:30 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No VIF found with MAC fa:16:3e:20:73:6b, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:43:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e46a3482-60b0-41c7-9697-775b2fb023c1 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.929s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:43:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:43:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing instance network info cache due to event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updated VIF entry in instance network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e5047dd1-f9d8-4611-b5eb-44f2c7ab661c req-b23cd831-db48-4a14-8544-440061623c04 service nova] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing instance network info cache due to event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:40 user nova-compute[71500]: DEBUG nova.network.neutron [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:43:41 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:41 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7568MB free_disk=26.105548858642578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d7088d6e-b443-4c76-8a13-199e0721ea36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.network.neutron [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updated VIF entry in instance network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.network.neutron [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32348893-12f7-46cc-94f9-7dddb8f2a1d1 req-5dfef35c-9f93-49c6-bfd1-abb36f2008f0 service nova] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:43:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:44 user nova-compute[71500]: INFO nova.compute.manager [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Rebooting instance
Apr 14 15:43:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-unplugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-unplugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:45 user nova-compute[71500]: WARNING nova.compute.manager [req-5710df52-3627-4881-ab2f-2eaf8f42d66e req-adeec8a5-b6bf-422e-a445-e3f404736970 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-unplugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state active and task_state reboot_started_hard.
Apr 14 15:43:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance destroyed successfully.
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'resources' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1381069102',display_name='tempest-TestMinimumBasicScenario-server-1381069102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1381069102',id=18,image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw==',key_name='tempest-TestMinimumBasicScenario-1176689891',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-0olith0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:43:45Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=d7088d6e-b443-4c76-8a13-199e0721ea36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05127b2a-2e, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:43:45 user nova-compute[71500]: INFO os_vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e')
Apr 14 15:43:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:43:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef2941-4dab-4e57-a9f7-b00a23157098]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:43:45 user nova-compute[71500]: No targets found.
Apr 14 15:43:45 user nova-compute[71500]: iSNS:
Apr 14 15:43:45 user nova-compute[71500]: No targets found.
Apr 14 15:43:45 user nova-compute[71500]: STATIC:
Apr 14 15:43:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:43:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:43:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:43:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:43:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:43:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:43:45 user nova-compute[71500]: FIRMWARE:
Apr 14 15:43:45 user nova-compute[71500]: No targets found.
Apr 14 15:43:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:43:45 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:43:45 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083991e-a7e5-4937-a6d1-86a4a54dab65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1360dc-3426-422f-b44c-a0720ce6d32b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:45 user nova-compute[71500]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:43:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:45 user nova-compute[71500]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:43:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a6c154-d5e6-469b-9859-1aac728282f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea2befb-e219-4349-9c27-5067d62849e6]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ca1e9a-8c66-4f7d-8109-cd3bccf532ff]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3c3a3-af34-4797-a2a8-6aa3679904c6]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[024bd4f4-5b2c-44d5-8909-bd5721316f6c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828c1be-8427-4e24-affb-ecf25b68a6b2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]
Apr 14 15:43:45 user nova-compute[71500]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.
Apr 14 15:43:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da21eaf-6efd-4d14-9ddc-f01bc3d98615]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== disconnect_volume: return (325ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Start _get_guest_xml network_info=[{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=07f87bf5-ccf2-4c81-8d43-c1a9d8492556,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': '07f87bf5-ccf2-4c81-8d43-c1a9d8492556'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '02b28fe2-7d15-492f-bab5-a06151cb3126', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd7088d6e-b443-4c76-8a13-199e0721ea36', 'attached_at': '', 'detached_at': '', 'volume_id': '25aefab3-a41b-41a7-bc7c-4f07017f7305', 'serial': '25aefab3-a41b-41a7-bc7c-4f07017f7305'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:43:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=07f87bf5-ccf2-4c81-8d43-c1a9d8492556,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'vcpu_model' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:43:46 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:43:46 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:43:46 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4edae93-ec6a-4ff0-8dd1-f7d7d4edc9cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:43:46 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dfc1ba-9256-4d1b-9f0a-2272f1233b84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305] added
Apr 14 15:43:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[38af1854-eed1-471d-a286-28809e4ec38c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5bc425-602a-4a6c-8781-9591ae211222]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylZPvqnB {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylZPvqnB" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cec2e4d-c061-4e6e-8a03-238aadeea45e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylZPvqnB'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62effa9-1ffc-4419-a081-9942597a0388]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d8f71-4526-4328-bd4b-3ee66b84be12]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[52279455-1526-4c0c-8ec1-ed1cf3464bea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]
Apr 14 15:43:46 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.
Apr 14 15:43:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4204127-4095-47e7-a0b5-07dbaa7658c4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f6efd5-8ca5-4fc1-a4a3-4fbfe4825fff]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:46 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:43:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:43:46 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:43:46 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acdda40-5af2-4a31-a1f1-8074ea4bb9e8]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:43:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:47 user nova-compute[71500]: WARNING nova.compute.manager [req-c6864025-4eee-4c66-a2d9-ec76cd3a3e1e req-274f8369-7fd7-4d50-896a-c7ffcaf2a318 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state active and task_state reboot_started_hard.
Apr 14 15:43:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23866303139656135', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866303139656135', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1381069102',display_name='tempest-TestMinimumBasicScenario-server-1381069102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1381069102',id=18,image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw==',key_name='tempest-TestMinimumBasicScenario-1176689891',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-0olith0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:43:45Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=d7088d6e-b443-4c76-8a13-199e0721ea36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'pci_devices' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:43:47 user nova-compute[71500]:   <uuid>d7088d6e-b443-4c76-8a13-199e0721ea36</uuid>
Apr 14 15:43:47 user nova-compute[71500]:   <name>instance-00000012</name>
Apr 14 15:43:47 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:43:47 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:43:47 user nova-compute[71500]:   <metadata>
Apr 14 15:43:47 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:43:47 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:43:47 user nova-compute[71500]:       <nova:name>tempest-TestMinimumBasicScenario-server-1381069102</nova:name>
Apr 14 15:43:47 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:43:46</nova:creationTime>
Apr 14 15:43:47 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:43:47 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:43:47 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:43:47 user nova-compute[71500]:       <nova:owner>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:user uuid="4e5d615d61ea4b1dafa4207d7b21e2d5">tempest-TestMinimumBasicScenario-554859149-project-member</nova:user>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:project uuid="6d21cbc9fcc74fdd8579bad00a8ba2eb">tempest-TestMinimumBasicScenario-554859149</nova:project>
Apr 14 15:43:47 user nova-compute[71500]:       </nova:owner>
Apr 14 15:43:47 user nova-compute[71500]:       <nova:root type="image" uuid="07f87bf5-ccf2-4c81-8d43-c1a9d8492556"/>
Apr 14 15:43:47 user nova-compute[71500]:       <nova:ports>
Apr 14 15:43:47 user nova-compute[71500]:         <nova:port uuid="05127b2a-2e86-4f6a-9fb3-9e2be5559bde">
Apr 14 15:43:47 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 15:43:47 user nova-compute[71500]:         </nova:port>
Apr 14 15:43:47 user nova-compute[71500]:       </nova:ports>
Apr 14 15:43:47 user nova-compute[71500]:     </nova:instance>
Apr 14 15:43:47 user nova-compute[71500]:   </metadata>
Apr 14 15:43:47 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:43:47 user nova-compute[71500]:     <system>
Apr 14 15:43:47 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:43:47 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:43:47 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:43:47 user nova-compute[71500]:       <entry name="serial">d7088d6e-b443-4c76-8a13-199e0721ea36</entry>
Apr 14 15:43:47 user nova-compute[71500]:       <entry name="uuid">d7088d6e-b443-4c76-8a13-199e0721ea36</entry>
Apr 14 15:43:47 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:43:47 user nova-compute[71500]:     </system>
Apr 14 15:43:47 user nova-compute[71500]:   </sysinfo>
Apr 14 15:43:47 user nova-compute[71500]:   <os>
Apr 14 15:43:47 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:43:47 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:43:47 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:43:47 user nova-compute[71500]:   </os>
Apr 14 15:43:47 user nova-compute[71500]:   <features>
Apr 14 15:43:47 user nova-compute[71500]:     <acpi/>
Apr 14 15:43:47 user nova-compute[71500]:     <apic/>
Apr 14 15:43:47 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:43:47 user nova-compute[71500]:   </features>
Apr 14 15:43:47 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:43:47 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:43:47 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:43:47 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:43:47 user nova-compute[71500]:   </clock>
Apr 14 15:43:47 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:43:47 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:43:47 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:43:47 user nova-compute[71500]:   </cpu>
Apr 14 15:43:47 user nova-compute[71500]:   <devices>
Apr 14 15:43:47 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:43:47 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:43:47 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk"/>
Apr 14 15:43:47 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:43:47 user nova-compute[71500]:     </disk>
Apr 14 15:43:47 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:43:47 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:43:47 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 15:43:47 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:43:47 user nova-compute[71500]:       <serial>25aefab3-a41b-41a7-bc7c-4f07017f7305</serial>
Apr 14 15:43:47 user nova-compute[71500]:     </disk>
Apr 14 15:43:47 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:43:47 user nova-compute[71500]:       <mac address="fa:16:3e:20:73:6b"/>
Apr 14 15:43:47 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:43:47 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:43:47 user nova-compute[71500]:       <target dev="tap05127b2a-2e"/>
Apr 14 15:43:47 user nova-compute[71500]:     </interface>
Apr 14 15:43:47 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:43:47 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/console.log" append="off"/>
Apr 14 15:43:47 user nova-compute[71500]:     </serial>
Apr 14 15:43:47 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:43:47 user nova-compute[71500]:     <video>
Apr 14 15:43:47 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:43:47 user nova-compute[71500]:     </video>
Apr 14 15:43:47 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:43:47 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:43:47 user nova-compute[71500]:     </rng>
Apr 14 15:43:47 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:43:47 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:43:47 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:43:47 user nova-compute[71500]:     </memballoon>
Apr 14 15:43:47 user nova-compute[71500]:   </devices>
Apr 14 15:43:47 user nova-compute[71500]: </domain>
Apr 14 15:43:47 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'trusted_certs' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:43:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Cannot resize image /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'migration_context' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1381069102',display_name='tempest-TestMinimumBasicScenario-server-1381069102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1381069102',id=18,image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw==',key_name='tempest-TestMinimumBasicScenario-1176689891',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-0olith0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:43:45Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=d7088d6e-b443-4c76-8a13-199e0721ea36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG os_vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05127b2a-2e, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05127b2a-2e, col_values=(('external_ids', {'iface-id': '05127b2a-2e86-4f6a-9fb3-9e2be5559bde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:73:6b', 'vm-uuid': 'd7088d6e-b443-4c76-8a13-199e0721ea36'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:48 user nova-compute[71500]: INFO os_vif [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e')
Apr 14 15:43:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:49 user nova-compute[71500]: WARNING nova.compute.manager [req-7c67ee54-8184-4808-8849-d95276c300aa req-d8639d12-1011-478a-bf6a-02fab7c120e4 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state active and task_state reboot_started_hard.
Apr 14 15:43:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for d7088d6e-b443-4c76-8a13-199e0721ea36 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487031.5487978, d7088d6e-b443-4c76-8a13-199e0721ea36 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] VM Resumed (Lifecycle Event)
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:43:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance rebooted successfully.
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487031.55013, d7088d6e-b443-4c76-8a13-199e0721ea36 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:43:51 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] VM Started (Lifecycle Event)
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d17cf640-4411-4b27-a0c7-209171f2e156 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.408s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:43:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:43:51 user nova-compute[71500]: WARNING nova.compute.manager [req-8d3eb578-a271-4547-b495-91ed6c7a1f5d req-9986f8c9-c683-4b32-8660-0e7d41755974 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state active and task_state None.
Apr 14 15:43:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:43:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:02 user nova-compute[71500]: INFO nova.compute.manager [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Terminating instance
Apr 14 15:44:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-b360709b-332b-40ab-94e3-e5b1b70effee req-98c285ab-9e9b-4f5e-9fd8-ae9779290ba6 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Instance destroyed successfully.
Apr 14 15:44:03 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lazy-loading 'resources' on Instance uuid 2d91a139-cb0c-40c1-99a1-6b34dcb60bed {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-660406846',display_name='tempest-ServerStableDeviceRescueTest-server-660406846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-660406846',id=4,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvPHEwKozg7h6r4JnJpSzBWhs511e+AcMrK/R2mBj8TGR21rZjvip0yg4hAZLhZammhHG2RLycjW8OY5YH3WpdSWl4G97OD9UkFa1PzKidrzi0TtxEVyGAc8SnkIc1I4Q==',key_name='tempest-keypair-985297908',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8230c5386464f288fd783b3c60536b4',ramdisk_id='',reservation_id='r-m8khbov7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2130046820',owner_user_name='tempest-ServerStableDeviceRescueTest-2130046820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f805db20d87d4429981c975ebd88ed92',uuid=2d91a139-cb0c-40c1-99a1-6b34dcb60bed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converting VIF {"id": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "address": "fa:16:3e:2c:45:27", "network": {"id": "3f472477-20b4-41e0-86c9-32659cc16f4f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-33302744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8230c5386464f288fd783b3c60536b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfb03b4e-c2", "ovs_interfaceid": "cfb03b4e-c244-4ebd-bff5-7e250ac32044", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG os_vif [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfb03b4e-c2, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:44:03 user nova-compute[71500]: INFO os_vif [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:45:27,bridge_name='br-int',has_traffic_filtering=True,id=cfb03b4e-c244-4ebd-bff5-7e250ac32044,network=Network(3f472477-20b4-41e0-86c9-32659cc16f4f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfb03b4e-c2')
Apr 14 15:44:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Deleting instance files /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed_del
Apr 14 15:44:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Deletion of /opt/stack/data/nova/instances/2d91a139-cb0c-40c1-99a1-6b34dcb60bed_del complete
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:03 user nova-compute[71500]: INFO nova.compute.manager [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 14 15:44:03 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:44:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:05 user nova-compute[71500]: WARNING nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state deleting.
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:05 user nova-compute[71500]: WARNING nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state deleting.
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:05 user nova-compute[71500]: WARNING nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state active and task_state deleting.
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-d258e891-9361-46bd-890d-33d9ee28c85a req-41d201e4-1e83-4178-a756-70e5d082dfaf service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-unplugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:44:05 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Took 2.00 seconds to deallocate network for instance.
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:44:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:06 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Deleted allocations for instance 2d91a139-cb0c-40c1-99a1-6b34dcb60bed
Apr 14 15:44:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9cd41055-d8d0-43cf-b89c-cfaa988e977e tempest-ServerStableDeviceRescueTest-2130046820 tempest-ServerStableDeviceRescueTest-2130046820-project-member] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.613s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Acquiring lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] Lock "2d91a139-cb0c-40c1-99a1-6b34dcb60bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] No waiting events found dispatching network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:07 user nova-compute[71500]: WARNING nova.compute.manager [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received unexpected event network-vif-plugged-cfb03b4e-c244-4ebd-bff5-7e250ac32044 for instance with vm_state deleted and task_state None.
Apr 14 15:44:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-7b92bd75-4f58-43c9-982a-4a8cdd2e0fd6 req-1b7a7790-9b2a-44c7-bf8f-5490b910dfe2 service nova] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Received event network-vif-deleted-cfb03b4e-c244-4ebd-bff5-7e250ac32044 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:08 user nova-compute[71500]: INFO nova.compute.manager [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Unrescuing
Apr 14 15:44:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:44:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:44:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:44:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'flavor' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:09 user nova-compute[71500]: WARNING nova.compute.manager [req-da5173bd-af7f-41e9-b0dc-7516717590bd req-b3ecfd24-7810-4e57-bd60-7ee0eb78a5b7 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance destroyed successfully.
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:11 user nova-compute[71500]: WARNING nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:11 user nova-compute[71500]: WARNING nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:11 user nova-compute[71500]: WARNING nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:11 user nova-compute[71500]: WARNING nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:11 user nova-compute[71500]: WARNING nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:11 user nova-compute[71500]: WARNING nova.compute.manager [req-a719a623-fa3a-48ee-8a6a-a78d8b4b9f46 req-92559182-9839-4628-811b-355137a9c9f2 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:44:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487053.7468843, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:44:13 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Resumed (Lifecycle Event)
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aed80abf-481f-4b9c-a1ae-8e4566075eaf tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:44:13 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487053.751089, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:44:13 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Started (Lifecycle Event)
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:44:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:44:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:14 user nova-compute[71500]: WARNING nova.compute.manager [req-8a549cd3-0636-4704-911b-fe6dc69bae5a req-a5578bed-942d-419e-a892-cbc39147af8d service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state active and task_state None.
Apr 14 15:44:18 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487043.4045894, 2d91a139-cb0c-40c1-99a1-6b34dcb60bed => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:44:18 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] VM Stopped (Lifecycle Event)
Apr 14 15:44:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-96e9b41f-8fda-4afc-9db9-218a63f70405 None None] [instance: 2d91a139-cb0c-40c1-99a1-6b34dcb60bed] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:44:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:44:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:44:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:44:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:44:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:44:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:44:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:44:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:44:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:44:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:44:35 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 0339b7d6-294b-4669-9782-51de5748226a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updating instance_info_cache with network_info: [{"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-0339b7d6-294b-4669-9782-51de5748226a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:44:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:44:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'flavor' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.112s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:40 user nova-compute[71500]: INFO nova.compute.manager [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attaching volume 8b38580d-ee34-4663-a8dd-8f2e35ffc774 to /dev/vdb
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG os_brick.utils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d0a60a-ce97-4977-be89-7ff6a8c5b859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[825f748b-5160-4d56-ab09-4aa3e7800475]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd384edb-ade2-41c1-9ee9-1979d40dea4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6d64b8-a19d-4063-8191-280272eed12b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:44:40 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c234b344-13e3-44c5-88c8-afec60830810]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG os_brick.utils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating existing volume attachment record: 004bb89c-86a7-410e-89f1-8c9497c01bc2 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:41 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:44:41 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=26.192142486572266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0339b7d6-294b-4669-9782-51de5748226a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d7088d6e-b443-4c76-8a13-199e0721ea36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:44:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:44:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:44:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:44:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:44:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:44:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:44:45 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d34984-618b-4780-923c-b25e4c2c004a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:44:45 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb56beb-65cc-4aab-b888-24b15b5bd5e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774] added
Apr 14 15:44:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[08726827-c3df-4062-83fc-d65531062329]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b2f77-6fd8-4686-856b-1185005ec772]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYkMpcna {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYkMpcna" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330f99f-815f-4440-ae5a-9cf1f4732b96]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYkMpcna'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c3675-bbb2-4171-91bd-017b3fd09c28]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e742e19-436f-4000-9f2d-a9782e0f65d6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a4e733-3649-4556-8c51-2f1a33c15ed7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]
Apr 14 15:44:45 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.
Apr 14 15:44:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[668316e8-fbad-4a37-af1e-55fddcffc57a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd83fd5-3991-4938-b52d-87c0086624a3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:44:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d894fe-30c9-4d96-9e2d-f24030a9b884]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26264653539613130', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264653539613130', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'flavor' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:44:46 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:44:46 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:44:46 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:44:46 user nova-compute[71500]:   <serial>8b38580d-ee34-4663-a8dd-8f2e35ffc774</serial>
Apr 14 15:44:46 user nova-compute[71500]: </disk>
Apr 14 15:44:46 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:44:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:23:f4:2a, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:44:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c154a9e0-d02a-43ee-850f-1eb0a5aff3ac tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.730s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:48 user nova-compute[71500]: INFO nova.compute.manager [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Rebuilding instance
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_requests' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_devices' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'migration_context' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71500) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:48 user nova-compute[71500]: DEBUG nova.compute.manager [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:48 user nova-compute[71500]: WARNING nova.compute.manager [req-17cd7d84-0579-479f-ac21-b8f9b6ba782d req-c3c8645a-14c3-4cc5-84de-c403b416d826 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state rebuilding.
Apr 14 15:44:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:49 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance destroyed successfully.
Apr 14 15:44:49 user nova-compute[71500]: INFO nova.compute.manager [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Detaching volume 8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:44:49 user nova-compute[71500]: INFO nova.virt.block_device [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attempting to driver detach volume 8b38580d-ee34-4663-a8dd-8f2e35ffc774 from mountpoint /dev/vdb
Apr 14 15:44:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Attempting to detach device vdb from instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:44:49 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:44:49 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:44:49 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:44:49 user nova-compute[71500]:   <serial>8b38580d-ee34-4663-a8dd-8f2e35ffc774</serial>
Apr 14 15:44:49 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:44:49 user nova-compute[71500]: </disk>
Apr 14 15:44:49 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:44:49 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully detached device vdb from instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 from the persistent domain config.
Apr 14 15:44:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:44:49 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24af9b-36bf-4d94-bf4e-f3669bc6a389]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:44:49 user nova-compute[71500]: No targets found.
Apr 14 15:44:49 user nova-compute[71500]: iSNS:
Apr 14 15:44:49 user nova-compute[71500]: No targets found.
Apr 14 15:44:49 user nova-compute[71500]: STATIC:
Apr 14 15:44:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:44:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:44:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:44:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:44:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:44:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:44:49 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:44:49 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:44:49 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:44:49 user nova-compute[71500]: FIRMWARE:
Apr 14 15:44:49 user nova-compute[71500]: No targets found.
Apr 14 15:44:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:44:49 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:44:49 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3a0f6d-22d3-407b-b208-491af11a5f7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4980699c-3431-47f8-9319-b05450dac09d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:49 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:49 user nova-compute[71500]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:44:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:49 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:49 user nova-compute[71500]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:44:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc110940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2f3403-8da8-4707-a4a1-7d0f8b8864b1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[129004a7-8fba-472f-951b-19f5965c1c35]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[077efdf7-85ab-4413-bfd9-49753169c9ce]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d190e7f-f694-4dce-83eb-05a0ebf195f8]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0071605-a271-493f-ab4c-5912819191a6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a2a618-b3fe-465c-81ba-60452af6e131]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]
Apr 14 15:44:49 user nova-compute[71500]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.
Apr 14 15:44:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7e775e-1eb4-4004-be86-7d55f76d04ce]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (306ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:44:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:44:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance destroyed successfully.
Apr 14 15:44:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:44:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a1caf6-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:50 user nova-compute[71500]: INFO os_vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:44:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:44:50 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a267845b-eb88-4310-b346-cd71c558d9fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:44:50 user nova-compute[71500]: No targets found.
Apr 14 15:44:50 user nova-compute[71500]: iSNS:
Apr 14 15:44:50 user nova-compute[71500]: No targets found.
Apr 14 15:44:50 user nova-compute[71500]: STATIC:
Apr 14 15:44:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:44:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:44:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:44:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:44:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:44:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:44:50 user nova-compute[71500]: FIRMWARE:
Apr 14 15:44:50 user nova-compute[71500]: No targets found.
Apr 14 15:44:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:44:50 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:44:50 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df3571-e125-4e4c-958a-d65aac26508a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[769ee25f-378c-4612-9bff-6b104e3e5952]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:50 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:50 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc112440>, {}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (75ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:44:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:44:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Deleting instance files /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_del
Apr 14 15:44:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Deletion of /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_del complete
Apr 14 15:44:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:44:51 user nova-compute[71500]: WARNING nova.compute.manager [req-873fa695-6fc5-4919-bb6a-c0c80a7f7a9a req-1305bdc9-76fe-49fe-8671-eff13c84fd42 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state rebuilding.
Apr 14 15:44:51 user nova-compute[71500]: INFO nova.virt.block_device [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Booting with volume 8b38580d-ee34-4663-a8dd-8f2e35ffc774 at /dev/vdb
Apr 14 15:44:51 user nova-compute[71500]: DEBUG os_brick.utils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a3990-c771-4305-8962-809ae4fb6bec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a075e6d3-df01-4c1f-8234-d57f7957c03a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c9ca9-a977-4faa-906a-07934c5e93f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[159126f2-8330-4bf4-ad9f-ba44aef380c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:44:51 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:44:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[32621087-4bf4-4424-84be-628d246f9d51]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG os_brick.utils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:44:51 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating existing volume attachment record: ae6ba2d1-5273-45ba-8ed5-2786864ffe15 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:44:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:44:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Creating image(s)
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.168s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk 1073741824" returned: 0 in 0.060s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Cannot resize image /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Ensure instance console log exists: /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start _get_guest_xml network_info=[{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'ae6ba2d1-5273-45ba-8ed5-2786864ffe15', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65', 'attached_at': '', 'detached_at': '', 'volume_id': '8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'serial': '8b38580d-ee34-4663-a8dd-8f2e35ffc774'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:44:56 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 15:44:56 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:44:56 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:44:56 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:44:56 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118367f-e38a-422c-8128-600beb332287]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:44:56 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091ec8f-f041-42a6-a6f2-3b3c09b3c6ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774] added
Apr 14 15:44:56 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[70882d3c-185b-4bfe-8b8d-fc1e2e64f638]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bae7852-904a-456d-81dc-bf8769800bb9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYkMpcna {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYkMpcna" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083ee66-ce2f-46b3-b3ff-c9b60b682e44]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYkMpcna'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81a6fdd-69d4-48ad-beb5-120f4a66287a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b54bff9-9346-4142-b015-53855b807191]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3fcb1-01d5-44a5-aa95-5d37a6de772a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]
Apr 14 15:44:57 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.
Apr 14 15:44:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242e487-768a-4d4e-8421-28225758fc82]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d514b0-522d-4fa4-9794-62f63affb0fa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:44:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ab6f3-e1b7-4e65-aff8-fa146166d7a7]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:44:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26264653539613130', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264653539613130', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:44:58 user nova-compute[71500]:   <uuid>fd224b68-1cc6-48cc-bcfe-a1ce40252e65</uuid>
Apr 14 15:44:58 user nova-compute[71500]:   <name>instance-00000011</name>
Apr 14 15:44:58 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:44:58 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:44:58 user nova-compute[71500]:   <metadata>
Apr 14 15:44:58 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:44:58 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:44:58 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-1544279830</nova:name>
Apr 14 15:44:58 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:44:56</nova:creationTime>
Apr 14 15:44:58 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:44:58 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:44:58 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:44:58 user nova-compute[71500]:       <nova:owner>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:44:58 user nova-compute[71500]:       </nova:owner>
Apr 14 15:44:58 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:44:58 user nova-compute[71500]:       <nova:ports>
Apr 14 15:44:58 user nova-compute[71500]:         <nova:port uuid="f5a1caf6-baf3-4c27-82c9-aab287c07447">
Apr 14 15:44:58 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:44:58 user nova-compute[71500]:         </nova:port>
Apr 14 15:44:58 user nova-compute[71500]:       </nova:ports>
Apr 14 15:44:58 user nova-compute[71500]:     </nova:instance>
Apr 14 15:44:58 user nova-compute[71500]:   </metadata>
Apr 14 15:44:58 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:44:58 user nova-compute[71500]:     <system>
Apr 14 15:44:58 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:44:58 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:44:58 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:44:58 user nova-compute[71500]:       <entry name="serial">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:44:58 user nova-compute[71500]:       <entry name="uuid">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:44:58 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:44:58 user nova-compute[71500]:     </system>
Apr 14 15:44:58 user nova-compute[71500]:   </sysinfo>
Apr 14 15:44:58 user nova-compute[71500]:   <os>
Apr 14 15:44:58 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:44:58 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:44:58 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:44:58 user nova-compute[71500]:   </os>
Apr 14 15:44:58 user nova-compute[71500]:   <features>
Apr 14 15:44:58 user nova-compute[71500]:     <acpi/>
Apr 14 15:44:58 user nova-compute[71500]:     <apic/>
Apr 14 15:44:58 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:44:58 user nova-compute[71500]:   </features>
Apr 14 15:44:58 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:44:58 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:44:58 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:44:58 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:44:58 user nova-compute[71500]:   </clock>
Apr 14 15:44:58 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:44:58 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:44:58 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:44:58 user nova-compute[71500]:   </cpu>
Apr 14 15:44:58 user nova-compute[71500]:   <devices>
Apr 14 15:44:58 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:44:58 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:44:58 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk"/>
Apr 14 15:44:58 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:44:58 user nova-compute[71500]:     </disk>
Apr 14 15:44:58 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:44:58 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:44:58 user nova-compute[71500]:       <source dev="/dev/sdd"/>
Apr 14 15:44:58 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:44:58 user nova-compute[71500]:       <serial>8b38580d-ee34-4663-a8dd-8f2e35ffc774</serial>
Apr 14 15:44:58 user nova-compute[71500]:     </disk>
Apr 14 15:44:58 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:44:58 user nova-compute[71500]:       <mac address="fa:16:3e:23:f4:2a"/>
Apr 14 15:44:58 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:44:58 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:44:58 user nova-compute[71500]:       <target dev="tapf5a1caf6-ba"/>
Apr 14 15:44:58 user nova-compute[71500]:     </interface>
Apr 14 15:44:58 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:44:58 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log" append="off"/>
Apr 14 15:44:58 user nova-compute[71500]:     </serial>
Apr 14 15:44:58 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:44:58 user nova-compute[71500]:     <video>
Apr 14 15:44:58 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:44:58 user nova-compute[71500]:     </video>
Apr 14 15:44:58 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:44:58 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:44:58 user nova-compute[71500]:     </rng>
Apr 14 15:44:58 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:44:58 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:44:58 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:44:58 user nova-compute[71500]:     </memballoon>
Apr 14 15:44:58 user nova-compute[71500]:   </devices>
Apr 14 15:44:58 user nova-compute[71500]: </domain>
Apr 14 15:44:58 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG os_vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a1caf6-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5a1caf6-ba, col_values=(('external_ids', {'iface-id': 'f5a1caf6-baf3-4c27-82c9-aab287c07447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:f4:2a', 'vm-uuid': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:58 user nova-compute[71500]: INFO os_vif [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:44:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:23:f4:2a, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:44:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:44:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:45:00 user nova-compute[71500]: WARNING nova.compute.manager [req-05e3f46a-722a-4eab-acc3-3980c06d513d req-bf0ebc0a-89da-4b34-b360-ed133fbafd1f service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 15:45:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:45:02 user nova-compute[71500]: WARNING nova.compute.manager [req-07d8ad2a-a348-4bf8-a712-41b6dd9104e8 req-22756158-abd5-46c0-ac7f-9cfa948c7bdd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for fd224b68-1cc6-48cc-bcfe-a1ce40252e65 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487102.149232, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:45:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Resumed (Lifecycle Event)
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:45:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance spawned successfully.
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487102.1506243, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:45:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Started (Lifecycle Event)
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:02 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 15:45:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG nova.objects.instance [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71500) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 15:45:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-daba53d2-6c46-4f33-b1da-8f128cf8febe tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-changed-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Refreshing instance network info cache due to event network-changed-3f7d69ad-aaff-498b-8862-241238c91a38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Acquiring lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Acquired lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Refreshing network info cache for port 3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updated VIF entry in instance network info cache for port 3f7d69ad-aaff-498b-8862-241238c91a38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating instance_info_cache with network_info: [{"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-952dde68-9d5a-403b-826c-c8e759cfecf3 req-3bbe2013-0951-4cfb-abd1-9ec6b3f88e79 service nova] Releasing lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG nova.objects.instance [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:04 user nova-compute[71500]: INFO nova.compute.manager [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attaching volume 597dad96-7242-4822-9c01-a5d1681ce980 to /dev/vdb
Apr 14 15:45:04 user nova-compute[71500]: DEBUG os_brick.utils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5c39a3-c5dd-4525-9141-ebabf30c55fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ec7d1-5333-451e-921e-5abcc3ca93f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d8f508-df5f-4a9b-b40e-195bcf6f366b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[772d01ae-60b9-4829-844d-05ebb4a114c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:45:04 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:45:04 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e202905-9b3d-4196-827c-a2ca13fe7c8f]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG os_brick.utils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:04 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating existing volume attachment record: c00e2d60-f698-4543-be5e-70751b191b0d {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:45:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-changed-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Refreshing instance network info cache due to event network-changed-59970400-49c0-4153-85a7-7b9b9496df26. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Acquiring lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Acquired lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Refreshing network info cache for port 59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'flavor' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzJXfYuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:09 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:09 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:09 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee4d727-0575-4665-9e02-89045cea7b06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:45:09 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[75733a56-5173-4f5a-8559-9c9c812fde03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980] added
Apr 14 15:45:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:09 user nova-compute[71500]: INFO nova.compute.manager [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Attaching volume e0991f31-aa0c-498b-934c-109652675c69 to /dev/vdb
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6d5520-be1b-43cc-82cf-67046ebe93c0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c235ca-9415-45c3-ae15-21450c9b0cfa]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzJXfYuR {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NzJXfYuR" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f033b5-01cd-4f13-bd7d-ff55964694a1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NzJXfYuR'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.utils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b5eab-6f88-4f3d-b81c-bea4a4618060]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb53e22f-a7ad-4b70-abdf-f8f0d8026195]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a8d122-3610-4269-a357-246756a9e2e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updated VIF entry in instance network info cache for port 59970400-49c0-4153-85a7-7b9b9496df26. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updating instance_info_cache with network_info: [{"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f303b-672a-4c36-ad30-dc4bdc44b812]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:09 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:09 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:09 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:09 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-db47dd32-ca8a-4c52-a196-890389bcdfc6 req-267b57c9-36bb-488b-91b7-ba6a5700f636 service nova] Releasing lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dadd6a2-4428-4492-8e0e-a75c5e1ed8c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ca1dbb-7302-4e7d-b42c-2db292d90dbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bc7bd5-1d95-450b-89d7-e77223590d30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260]
Apr 14 15:45:10 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260] successful.
Apr 14 15:45:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:45:10 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcc428-f5aa-4cec-b69f-d6fb8b7d7963]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.utils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updating existing volume attachment record: 5c73bac8-f637-4c41-8ccd-52ed0e1b77a4 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b97f5f-bb5e-4855-a1b8-942aee601b81]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafd498-d751-4a0d-a3c1-82fd6e723726]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8424f-6294-4ddb-935f-7a8d9c47148b]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:10 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzJXfYuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23665663666323561', 'path': '/dev/sde'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665663666323561', 'path': '/dev/sde'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG nova.objects.instance [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:45:11 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:11 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:45:11 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:11 user nova-compute[71500]:   <serial>597dad96-7242-4822-9c01-a5d1681ce980</serial>
Apr 14 15:45:11 user nova-compute[71500]: </disk>
Apr 14 15:45:11 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No VIF found with MAC fa:16:3e:c3:bc:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:45:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-27e49867-41d8-4bfe-9a0d-b7af4b4cae29 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.385s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkvzTprU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:16 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:16 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:16 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef79fe6-487e-4ec4-9a86-40e7b897d1b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:45:16 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5a07c-c10f-4ff7-b5e1-1a9cac16f0fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69] added
Apr 14 15:45:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[281695ea-7831-441d-a111-fe6273a4eb26]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[becb1d20-a47a-4a10-b472-eea7eeb80143]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkvzTprU {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZkvzTprU" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[399bb756-46aa-4034-909d-51840f94daab]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZkvzTprU'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3c65a5-1d9c-410d-9d6e-6a37e03043d4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bb8de0-11b0-4e4b-9b9b-cd5fc8504632]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[78abdf7f-e8bd-40e3-942e-09e9795c846d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260]
Apr 14 15:45:17 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260] successful.
Apr 14 15:45:17 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bb3c43-54f9-4dae-abc8-ab279a0fa22f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8d3c2-b3ea-4abe-8cee-6fa5b185050a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 (non-flash)
Apr 14 15:45:17 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed3e3c-fb5d-41e6-aee1-8a9270ab1e40]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:45:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkvzTprU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23234643539656166', 'path': '/dev/sdf'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234643539656166', 'path': '/dev/sdf'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'flavor' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:45:18 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:18 user nova-compute[71500]:   <source dev="/dev/sdf"/>
Apr 14 15:45:18 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:18 user nova-compute[71500]:   <serial>e0991f31-aa0c-498b-934c-109652675c69</serial>
Apr 14 15:45:18 user nova-compute[71500]: </disk>
Apr 14 15:45:18 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:45:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No VIF found with MAC fa:16:3e:99:65:56, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:45:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-24970474-2ff2-4675-abed-09aed34b507c tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.223s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:45:20 user nova-compute[71500]: INFO nova.compute.claims [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Claim successful on node user
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:45:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.policy [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fa924fefda1428d81152fd573540f26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609ac7b149e14baab270d83a2646fbdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:45:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Creating image(s)
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.179s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "0339b7d6-294b-4669-9782-51de5748226a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:21 user nova-compute[71500]: INFO nova.compute.manager [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Terminating instance
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk 1073741824" returned: 0 in 0.072s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:21 user nova-compute[71500]: INFO nova.compute.manager [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Detaching volume e0991f31-aa0c-498b-934c-109652675c69
Apr 14 15:45:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.177s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:21 user nova-compute[71500]: INFO nova.virt.block_device [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Attempting to driver detach volume e0991f31-aa0c-498b-934c-109652675c69 from mountpoint /dev/vdb
Apr 14 15:45:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Attempting to detach device vdb from instance 203e4039-aa71-4521-8e74-02452436cb60 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:45:21 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:21 user nova-compute[71500]:   <source dev="/dev/sdf"/>
Apr 14 15:45:21 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:21 user nova-compute[71500]:   <serial>e0991f31-aa0c-498b-934c-109652675c69</serial>
Apr 14 15:45:21 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:45:21 user nova-compute[71500]: </disk>
Apr 14 15:45:21 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:45:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully detached device vdb from instance 203e4039-aa71-4521-8e74-02452436cb60 from the persistent domain config.
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 203e4039-aa71-4521-8e74-02452436cb60 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:45:21 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:21 user nova-compute[71500]:   <source dev="/dev/sdf"/>
Apr 14 15:45:21 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:21 user nova-compute[71500]:   <serial>e0991f31-aa0c-498b-934c-109652675c69</serial>
Apr 14 15:45:21 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:45:21 user nova-compute[71500]: </disk>
Apr 14 15:45:21 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Cannot resize image /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'migration_context' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Ensure instance console log exists: /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Successfully created port: 152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-vif-unplugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] No waiting events found dispatching network-vif-unplugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:45:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-acde2941-e9e9-4983-8fdb-c83a3106b5c1 req-b36bba24-2d85-45ad-b894-169fdb098666 service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-vif-unplugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487122.0461314, 203e4039-aa71-4521-8e74-02452436cb60 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:45:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully detached device vdb from instance 203e4039-aa71-4521-8e74-02452436cb60 from the live domain config.
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZkvzTprU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[db89ef54-de3a-4e98-a5e2-970ec211b235]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:45:22 user nova-compute[71500]: No targets found.
Apr 14 15:45:22 user nova-compute[71500]: iSNS:
Apr 14 15:45:22 user nova-compute[71500]: No targets found.
Apr 14 15:45:22 user nova-compute[71500]: STATIC:
Apr 14 15:45:22 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980
Apr 14 15:45:22 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:22 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:22 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69
Apr 14 15:45:22 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:22 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:22 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:45:22 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:22 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:22 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:45:22 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:22 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:22 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:45:22 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:22 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:22 user nova-compute[71500]: FIRMWARE:
Apr 14 15:45:22 user nova-compute[71500]: No targets found.
Apr 14 15:45:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:45:22 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:45:22 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2abf3d-e326-4c7f-825f-0fd2c53733d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7742b9e-3cf8-4d42-a0c0-56b1008ca148]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 (non-flash)
Apr 14 15:45:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc7ea3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69'): ({'sdf'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Removing single pathed devices sdf {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4b003a-f0e2-4834-80d7-13797ece46ac]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[068de415-e306-40a2-bd98-e813faf0db89]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flushing IO for device /dev/sdf {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[005c824f-4619-4bdd-9498-5c01b15962c9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2efd0-4e7d-4e67-b389-8b07ad88499f]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] SCSI volumes sdf have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574d10f-b51f-42e1-8def-bcbf1c904f68]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed90789-a51b-4821-9f50-bca802c560f8]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260]
Apr 14 15:45:22 user nova-compute[71500]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69, portal: 172.16.0.220,3260] successful.
Apr 14 15:45:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0991f31-aa0c-498b-934c-109652675c69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61bb08f-a5e4-4c57-8310-18a0829a6097]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] <== disconnect_volume: return (363ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:45:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Instance destroyed successfully.
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lazy-loading 'resources' on Instance uuid 0339b7d6-294b-4669-9782-51de5748226a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1469009849',display_name='tempest-ServersNegativeTestJSON-server-1469009849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1469009849',id=2,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a8e73ef2ad94e84876def53ddf43da4',ramdisk_id='',reservation_id='r-l1ma4hs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-443911091',owner_user_name='tempest-ServersNegativeTestJSON-443911091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:36:51Z,user_data=None,user_id='af824b840c604223afd90bce17fe1ceb',uuid=0339b7d6-294b-4669-9782-51de5748226a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converting VIF {"id": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "address": "fa:16:3e:56:db:15", "network": {"id": "dd14d44b-4a04-4aa4-9dfd-1933f29c3a40", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1855867442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a8e73ef2ad94e84876def53ddf43da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29225f48-b8", "ovs_interfaceid": "29225f48-b889-4b7d-b5be-6c47f5c4b076", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG os_vif [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29225f48-b8, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:22 user nova-compute[71500]: INFO os_vif [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:db:15,bridge_name='br-int',has_traffic_filtering=True,id=29225f48-b889-4b7d-b5be-6c47f5c4b076,network=Network(dd14d44b-4a04-4aa4-9dfd-1933f29c3a40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29225f48-b8')
Apr 14 15:45:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Deleting instance files /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a_del
Apr 14 15:45:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Deletion of /opt/stack/data/nova/instances/0339b7d6-294b-4669-9782-51de5748226a_del complete
Apr 14 15:45:22 user nova-compute[71500]: INFO nova.compute.manager [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Took 1.25 seconds to destroy the instance on the hypervisor.
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Successfully updated port: 152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'flavor' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2b3787ff-9226-4bb7-8cc3-73ea095af753 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.971s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:23 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Took 1.04 seconds to deallocate network for instance.
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance network_info: |[{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Start _get_guest_xml network_info=[{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:45:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:45:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-105829218',display_name='tempest-ServerRescueNegativeTestJSON-server-105829218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-105829218',id=21,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpwpHpSgjKFFOfT3sSZFGtHW7aHEqY3D7iHTUwEt+HEW6CaFV/NwHuNuh6qVxkjw80tHEBbK1oT4PIGP9fCBT1gDmfTs67kVNJUEGodNvnDGO8uYB8ceVoLe2Fz/R9eFA==',key_name='tempest-keypair-2069158824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-v13126gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa924fefda1428d81152fd573540f26',uuid=f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'pci_devices' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:45:23 user nova-compute[71500]:   <uuid>f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72</uuid>
Apr 14 15:45:23 user nova-compute[71500]:   <name>instance-00000015</name>
Apr 14 15:45:23 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:45:23 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:45:23 user nova-compute[71500]:   <metadata>
Apr 14 15:45:23 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:45:23 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:45:23 user nova-compute[71500]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-105829218</nova:name>
Apr 14 15:45:23 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:45:23</nova:creationTime>
Apr 14 15:45:23 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:45:23 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:45:23 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:45:23 user nova-compute[71500]:       <nova:owner>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:user uuid="3fa924fefda1428d81152fd573540f26">tempest-ServerRescueNegativeTestJSON-1174024196-project-member</nova:user>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:project uuid="609ac7b149e14baab270d83a2646fbdf">tempest-ServerRescueNegativeTestJSON-1174024196</nova:project>
Apr 14 15:45:23 user nova-compute[71500]:       </nova:owner>
Apr 14 15:45:23 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:45:23 user nova-compute[71500]:       <nova:ports>
Apr 14 15:45:23 user nova-compute[71500]:         <nova:port uuid="152ccc41-c6f1-40f5-9ea2-0449a4f45748">
Apr 14 15:45:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 15:45:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:45:23 user nova-compute[71500]:       </nova:ports>
Apr 14 15:45:23 user nova-compute[71500]:     </nova:instance>
Apr 14 15:45:23 user nova-compute[71500]:   </metadata>
Apr 14 15:45:23 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:45:23 user nova-compute[71500]:     <system>
Apr 14 15:45:23 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:45:23 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:45:23 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:45:23 user nova-compute[71500]:       <entry name="serial">f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72</entry>
Apr 14 15:45:23 user nova-compute[71500]:       <entry name="uuid">f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72</entry>
Apr 14 15:45:23 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:45:23 user nova-compute[71500]:     </system>
Apr 14 15:45:23 user nova-compute[71500]:   </sysinfo>
Apr 14 15:45:23 user nova-compute[71500]:   <os>
Apr 14 15:45:23 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:45:23 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:45:23 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:45:23 user nova-compute[71500]:   </os>
Apr 14 15:45:23 user nova-compute[71500]:   <features>
Apr 14 15:45:23 user nova-compute[71500]:     <acpi/>
Apr 14 15:45:23 user nova-compute[71500]:     <apic/>
Apr 14 15:45:23 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:45:23 user nova-compute[71500]:   </features>
Apr 14 15:45:23 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:45:23 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:45:23 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:45:23 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:45:23 user nova-compute[71500]:   </clock>
Apr 14 15:45:23 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:45:23 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:45:23 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:45:23 user nova-compute[71500]:   </cpu>
Apr 14 15:45:23 user nova-compute[71500]:   <devices>
Apr 14 15:45:23 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:45:23 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:45:23 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk"/>
Apr 14 15:45:23 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:45:23 user nova-compute[71500]:     </disk>
Apr 14 15:45:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:45:23 user nova-compute[71500]:       <mac address="fa:16:3e:2d:3d:d7"/>
Apr 14 15:45:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:45:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:45:23 user nova-compute[71500]:       <target dev="tap152ccc41-c6"/>
Apr 14 15:45:23 user nova-compute[71500]:     </interface>
Apr 14 15:45:23 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:45:23 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/console.log" append="off"/>
Apr 14 15:45:23 user nova-compute[71500]:     </serial>
Apr 14 15:45:23 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:45:23 user nova-compute[71500]:     <video>
Apr 14 15:45:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:45:23 user nova-compute[71500]:     </video>
Apr 14 15:45:23 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:45:23 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:45:23 user nova-compute[71500]:     </rng>
Apr 14 15:45:23 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:45:23 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:45:23 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:45:23 user nova-compute[71500]:     </memballoon>
Apr 14 15:45:23 user nova-compute[71500]:   </devices>
Apr 14 15:45:23 user nova-compute[71500]: </domain>
Apr 14 15:45:23 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-105829218',display_name='tempest-ServerRescueNegativeTestJSON-server-105829218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-105829218',id=21,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpwpHpSgjKFFOfT3sSZFGtHW7aHEqY3D7iHTUwEt+HEW6CaFV/NwHuNuh6qVxkjw80tHEBbK1oT4PIGP9fCBT1gDmfTs67kVNJUEGodNvnDGO8uYB8ceVoLe2Fz/R9eFA==',key_name='tempest-keypair-2069158824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-v13126gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa924fefda1428d81152fd573540f26',uuid=f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG os_vif [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap152ccc41-c6, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap152ccc41-c6, col_values=(('external_ids', {'iface-id': '152ccc41-c6f1-40f5-9ea2-0449a4f45748', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:3d:d7', 'vm-uuid': 'f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:23 user nova-compute[71500]: INFO os_vif [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6')
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:2d:3d:d7, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Acquiring lock "0339b7d6-294b-4669-9782-51de5748226a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Lock "0339b7d6-294b-4669-9782-51de5748226a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] No waiting events found dispatching network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:45:23 user nova-compute[71500]: WARNING nova.compute.manager [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received unexpected event network-vif-plugged-29225f48-b889-4b7d-b5be-6c47f5c4b076 for instance with vm_state deleted and task_state None.
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing instance network info cache due to event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:24 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Deleted allocations for instance 0339b7d6-294b-4669-9782-51de5748226a
Apr 14 15:45:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0fc04191-7f46-4ce9-a1ec-99167a1f8d5b tempest-ServersNegativeTestJSON-443911091 tempest-ServersNegativeTestJSON-443911091-project-member] Lock "0339b7d6-294b-4669-9782-51de5748226a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.084s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updated VIF entry in instance network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-1bda70f4-1432-45a7-bfae-ee72fd5e9628 req-a1fbc1c6-82ff-4a5d-88f6-debbf34b56ad service nova] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Received event network-vif-deleted-29225f48-b889-4b7d-b5be-6c47f5c4b076 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:45:25 user nova-compute[71500]: WARNING nova.compute.manager [req-b63b581a-a16f-40aa-b09b-61c3fd72ee7d req-2f383e1f-4705-4ef0-a2e2-20a4a234ca77 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state building and task_state spawning.
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487127.4585795, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Resumed (Lifecycle Event)
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance spawned successfully.
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487127.460583, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Started (Lifecycle Event)
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:45:27 user nova-compute[71500]: WARNING nova.compute.manager [req-f20994c5-c144-444c-971a-5c8cbae335ee req-fb6f0dfd-8aa0-48ea-9253-2188109c6950 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state building and task_state spawning.
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Took 6.70 seconds to spawn the instance on the hypervisor.
Apr 14 15:45:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:27 user nova-compute[71500]: INFO nova.compute.manager [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Took 7.54 seconds to build instance.
Apr 14 15:45:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ba5b6d77-6b45-4b08-9720-8e1d470d199d tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.672s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updating instance_info_cache with network_info: [{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:45:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:34 user nova-compute[71500]: INFO nova.compute.manager [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Detaching volume 597dad96-7242-4822-9c01-a5d1681ce980
Apr 14 15:45:34 user nova-compute[71500]: INFO nova.virt.block_device [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attempting to driver detach volume 597dad96-7242-4822-9c01-a5d1681ce980 from mountpoint /dev/vdb
Apr 14 15:45:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Attempting to detach device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:45:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:45:34 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:34 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:45:34 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:34 user nova-compute[71500]:   <serial>597dad96-7242-4822-9c01-a5d1681ce980</serial>
Apr 14 15:45:34 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:45:34 user nova-compute[71500]: </disk>
Apr 14 15:45:34 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:45:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config.
Apr 14 15:45:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:45:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:45:34 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:34 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:45:34 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:34 user nova-compute[71500]:   <serial>597dad96-7242-4822-9c01-a5d1681ce980</serial>
Apr 14 15:45:34 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:45:34 user nova-compute[71500]: </disk>
Apr 14 15:45:34 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487135.4680784, cc81318c-1157-4832-919a-28cc14431f48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:45:35 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config.
Apr 14 15:45:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NzJXfYuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:35 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd8b55a-6cae-4406-9017-cea22448ac6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:45:35 user nova-compute[71500]: No targets found.
Apr 14 15:45:35 user nova-compute[71500]: iSNS:
Apr 14 15:45:35 user nova-compute[71500]: No targets found.
Apr 14 15:45:35 user nova-compute[71500]: STATIC:
Apr 14 15:45:35 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980
Apr 14 15:45:35 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:35 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:35 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:45:35 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:35 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:35 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:45:35 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:35 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:35 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:45:35 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:35 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:35 user nova-compute[71500]: FIRMWARE:
Apr 14 15:45:35 user nova-compute[71500]: No targets found.
Apr 14 15:45:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:45:35 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:45:35 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7365359b-214e-43d4-bbfd-4f95411fac03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd38173-8a3e-400e-9f98-ee67ab588a9a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 (non-flash)
Apr 14 15:45:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae021f64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980'): ({'sde'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Removing single pathed devices sde {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d472b2-82db-45d5-adbf-b1cae124ff60]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.041s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1014fd7-3776-43fb-aaec-9f4e4d36ca0c]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flushing IO for device /dev/sde {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6112b8bd-5aac-478c-ada6-3b0c40cd680d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb797c37-7279-46e1-89f5-fd3844791d9e]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac6591-4996-418e-9b4f-ab225e5ffbf5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc6978-6d9d-4d05-b0d0-7e4d45b0c853]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260]
Apr 14 15:45:35 user nova-compute[71500]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980, portal: 172.16.0.220,3260] successful.
Apr 14 15:45:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:597dad96-7242-4822-9c01-a5d1681ce980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbce02c-7f8e-4c55-8a74-8baa36e56ec0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== disconnect_volume: return (423ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing instance network info cache due to event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bf3bbe4d-65a7-4bb7-99d0-1a605ed687db tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.509s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updated VIF entry in instance network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6af1d232-0205-4c46-956f-78e30d0e35fb req-3a34619b-105c-4d79-a2cb-2ed2d15d6fba service nova] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487122.432938, 0339b7d6-294b-4669-9782-51de5748226a => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:45:37 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0339b7d6-294b-4669-9782-51de5748226a] VM Stopped (Lifecycle Event)
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-773a7d2b-8636-4f87-84f7-501b84b5ceef None None] [instance: 0339b7d6-294b-4669-9782-51de5748226a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing instance network info cache due to event network-changed-05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Acquiring lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Acquired lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:45:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Refreshing network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:38 user nova-compute[71500]: INFO nova.compute.manager [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Detaching volume 25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:45:38 user nova-compute[71500]: INFO nova.virt.block_device [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Attempting to driver detach volume 25aefab3-a41b-41a7-bc7c-4f07017f7305 from mountpoint /dev/vdb
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Attempting to detach device vdb from instance d7088d6e-b443-4c76-8a13-199e0721ea36 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:45:38 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:38 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:45:38 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:38 user nova-compute[71500]:   <serial>25aefab3-a41b-41a7-bc7c-4f07017f7305</serial>
Apr 14 15:45:38 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 15:45:38 user nova-compute[71500]: </disk>
Apr 14 15:45:38 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:45:38 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully detached device vdb from instance d7088d6e-b443-4c76-8a13-199e0721ea36 from the persistent domain config.
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d7088d6e-b443-4c76-8a13-199e0721ea36 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:45:38 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:45:38 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:45:38 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:45:38 user nova-compute[71500]:   <serial>25aefab3-a41b-41a7-bc7c-4f07017f7305</serial>
Apr 14 15:45:38 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 15:45:38 user nova-compute[71500]: </disk>
Apr 14 15:45:38 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updated VIF entry in instance network info cache for port 05127b2a-2e86-4f6a-9fb3-9e2be5559bde. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [{"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b33d99d5-429c-4bf7-9bae-eed4447194a4 req-c6c6938d-3355-4d19-9fd4-19c9e3f96d72 service nova] Releasing lock "refresh_cache-d7088d6e-b443-4c76-8a13-199e0721ea36" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487138.6706452, d7088d6e-b443-4c76-8a13-199e0721ea36 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:45:38 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully detached device vdb from instance d7088d6e-b443-4c76-8a13-199e0721ea36 from the live domain config.
Apr 14 15:45:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylZPvqnB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:45:38 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[07840682-6368-44ec-9b56-086521cc95e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:45:38 user nova-compute[71500]: No targets found.
Apr 14 15:45:38 user nova-compute[71500]: iSNS:
Apr 14 15:45:38 user nova-compute[71500]: No targets found.
Apr 14 15:45:38 user nova-compute[71500]: STATIC:
Apr 14 15:45:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:45:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305
Apr 14 15:45:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:45:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:45:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:45:38 user nova-compute[71500]: FIRMWARE:
Apr 14 15:45:38 user nova-compute[71500]: No targets found.
Apr 14 15:45:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:45:38 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:45:38 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1030740-e979-44d5-adba-6c1b848da6c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[09478f76-fd1d-4432-b258-42dda2b9be67]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:38 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:38 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:45:38 user nova-compute[71500]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 (non-flash)
Apr 14 15:45:38 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:45:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae020c5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d7447b-8b03-4427-8478-f6f43da010e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c188fc6-4524-4000-8a52-830e0eb68e7f]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e76e7c-4f1f-49a9-842f-cf07de0a4555]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73918d9-8df4-48e8-8866-437a443622d4]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b678db-ba41-4088-ab3b-e5856297615f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfb156f-c947-4060-b7b8-d1ef0aaf04c6]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260]
Apr 14 15:45:38 user nova-compute[71500]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305, portal: 172.16.0.220,3260] successful.
Apr 14 15:45:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25aefab3-a41b-41a7-bc7c-4f07017f7305 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c4d78-f654-49d8-ac2c-9dd4af4d6279]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== disconnect_volume: return (327ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:45:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'flavor' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7be39e6-ad79-41c4-b491-c3e51653cadf tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.270s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:45:43 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:45:43 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=26.170516967773438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d7088d6e-b443-4c76-8a13-199e0721ea36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:45:43 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:45:44 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:45:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:45:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:45:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:45:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:45:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:45:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:46:01 user nova-compute[71500]: INFO nova.compute.claims [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Claim successful on node user
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:46:01 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.policy [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:46:01 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Creating image(s)
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk 1073741824" returned: 0 in 0.052s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Cannot resize image /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG nova.objects.instance [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'migration_context' on Instance uuid ae5542b8-ac5f-40a6-bbff-8a2734a01583 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Successfully created port: cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Ensure instance console log exists: /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Successfully updated port: cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-changed-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Refreshing instance network info cache due to event network-changed-cd9b8743-1e76-4694-91d4-4420b8e16ce2. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Acquiring lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Updating instance_info_cache with network_info: [{"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Instance network_info: |[{"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Acquired lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Refreshing network info cache for port cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Start _get_guest_xml network_info=[{"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:46:03 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:03 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1749968002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1749968002',id=22,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-e1qj5ig4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:46:02Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=ae5542b8-ac5f-40a6-bbff-8a2734a01583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.objects.instance [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'pci_devices' on Instance uuid ae5542b8-ac5f-40a6-bbff-8a2734a01583 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:46:03 user nova-compute[71500]:   <uuid>ae5542b8-ac5f-40a6-bbff-8a2734a01583</uuid>
Apr 14 15:46:03 user nova-compute[71500]:   <name>instance-00000016</name>
Apr 14 15:46:03 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:46:03 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:46:03 user nova-compute[71500]:   <metadata>
Apr 14 15:46:03 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:46:03 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:46:03 user nova-compute[71500]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1749968002</nova:name>
Apr 14 15:46:03 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:46:03</nova:creationTime>
Apr 14 15:46:03 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:46:03 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:46:03 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:46:03 user nova-compute[71500]:       <nova:owner>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:user uuid="efb645d110464e7e85d7c955ee9f3466">tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member</nova:user>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:project uuid="584a53650c014f87b9622f2011996200">tempest-ServerBootFromVolumeStableRescueTest-756745587</nova:project>
Apr 14 15:46:03 user nova-compute[71500]:       </nova:owner>
Apr 14 15:46:03 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:46:03 user nova-compute[71500]:       <nova:ports>
Apr 14 15:46:03 user nova-compute[71500]:         <nova:port uuid="cd9b8743-1e76-4694-91d4-4420b8e16ce2">
Apr 14 15:46:03 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 15:46:03 user nova-compute[71500]:         </nova:port>
Apr 14 15:46:03 user nova-compute[71500]:       </nova:ports>
Apr 14 15:46:03 user nova-compute[71500]:     </nova:instance>
Apr 14 15:46:03 user nova-compute[71500]:   </metadata>
Apr 14 15:46:03 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:46:03 user nova-compute[71500]:     <system>
Apr 14 15:46:03 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:46:03 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:46:03 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:46:03 user nova-compute[71500]:       <entry name="serial">ae5542b8-ac5f-40a6-bbff-8a2734a01583</entry>
Apr 14 15:46:03 user nova-compute[71500]:       <entry name="uuid">ae5542b8-ac5f-40a6-bbff-8a2734a01583</entry>
Apr 14 15:46:03 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:46:03 user nova-compute[71500]:     </system>
Apr 14 15:46:03 user nova-compute[71500]:   </sysinfo>
Apr 14 15:46:03 user nova-compute[71500]:   <os>
Apr 14 15:46:03 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:46:03 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:46:03 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:46:03 user nova-compute[71500]:   </os>
Apr 14 15:46:03 user nova-compute[71500]:   <features>
Apr 14 15:46:03 user nova-compute[71500]:     <acpi/>
Apr 14 15:46:03 user nova-compute[71500]:     <apic/>
Apr 14 15:46:03 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:46:03 user nova-compute[71500]:   </features>
Apr 14 15:46:03 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:46:03 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:46:03 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:46:03 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:46:03 user nova-compute[71500]:   </clock>
Apr 14 15:46:03 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:46:03 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:46:03 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:46:03 user nova-compute[71500]:   </cpu>
Apr 14 15:46:03 user nova-compute[71500]:   <devices>
Apr 14 15:46:03 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:46:03 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:46:03 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk"/>
Apr 14 15:46:03 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:46:03 user nova-compute[71500]:     </disk>
Apr 14 15:46:03 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:46:03 user nova-compute[71500]:       <mac address="fa:16:3e:cf:e3:00"/>
Apr 14 15:46:03 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:46:03 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:46:03 user nova-compute[71500]:       <target dev="tapcd9b8743-1e"/>
Apr 14 15:46:03 user nova-compute[71500]:     </interface>
Apr 14 15:46:03 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:46:03 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/console.log" append="off"/>
Apr 14 15:46:03 user nova-compute[71500]:     </serial>
Apr 14 15:46:03 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:46:03 user nova-compute[71500]:     <video>
Apr 14 15:46:03 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:46:03 user nova-compute[71500]:     </video>
Apr 14 15:46:03 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:46:03 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:46:03 user nova-compute[71500]:     </rng>
Apr 14 15:46:03 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:46:03 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:46:03 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:46:03 user nova-compute[71500]:     </memballoon>
Apr 14 15:46:03 user nova-compute[71500]:   </devices>
Apr 14 15:46:03 user nova-compute[71500]: </domain>
Apr 14 15:46:03 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1749968002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1749968002',id=22,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-e1qj5ig4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:46:02Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=ae5542b8-ac5f-40a6-bbff-8a2734a01583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG os_vif [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd9b8743-1e, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd9b8743-1e, col_values=(('external_ids', {'iface-id': 'cd9b8743-1e76-4694-91d4-4420b8e16ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:e3:00', 'vm-uuid': 'ae5542b8-ac5f-40a6-bbff-8a2734a01583'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:03 user nova-compute[71500]: INFO os_vif [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e')
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No VIF found with MAC fa:16:3e:cf:e3:00, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Updated VIF entry in instance network info cache for port cd9b8743-1e76-4694-91d4-4420b8e16ce2. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Updating instance_info_cache with network_info: [{"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bcbc61da-5b3b-427a-992f-c20863352491 req-0321368e-6326-402f-a85d-c672e303d70a service nova] Releasing lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:05 user nova-compute[71500]: WARNING nova.compute.manager [req-4449f8d3-b3d1-40bd-bf97-47d9a7f60d96 req-bec4be49-ed05-438f-981c-cd23e7f1fec4 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state building and task_state spawning.
Apr 14 15:46:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487167.0691605, ae5542b8-ac5f-40a6-bbff-8a2734a01583 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] VM Resumed (Lifecycle Event)
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Instance spawned successfully.
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487167.0700336, ae5542b8-ac5f-40a6-bbff-8a2734a01583 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] VM Started (Lifecycle Event)
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:07 user nova-compute[71500]: WARNING nova.compute.manager [req-318eb981-2e77-4454-af71-be93eafdd42a req-2638213c-8740-481c-8a04-01af943bd151 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state building and task_state spawning.
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 14 15:46:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:07 user nova-compute[71500]: INFO nova.compute.manager [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Took 6.23 seconds to build instance.
Apr 14 15:46:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-82699aa7-873c-4a56-80aa-2c2a17f12c2f tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.445s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:15 user nova-compute[71500]: INFO nova.compute.manager [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] instance snapshotting
Apr 14 15:46:16 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Beginning live snapshot process
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.158s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo7rfx7pi/c30d9ae7c6d34ab8a15a602ae94f02c2.delta 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpo7rfx7pi/c30d9ae7c6d34ab8a15a602ae94f02c2.delta 1073741824" returned: 0 in 0.058s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:16 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 15:46:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:46:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:46:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 15:46:18 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:46:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo7rfx7pi/c30d9ae7c6d34ab8a15a602ae94f02c2.delta /opt/stack/data/nova/instances/snapshots/tmpo7rfx7pi/c30d9ae7c6d34ab8a15a602ae94f02c2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpo7rfx7pi/c30d9ae7c6d34ab8a15a602ae94f02c2.delta /opt/stack/data/nova/instances/snapshots/tmpo7rfx7pi/c30d9ae7c6d34ab8a15a602ae94f02c2" returned: 0 in 0.292s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Snapshot extracted, beginning image upload
Apr 14 15:46:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Snapshot image upload complete
Apr 14 15:46:21 user nova-compute[71500]: INFO nova.compute.manager [None req-3b5fdc34-c0f0-487e-b47e-24a4072d5779 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Took 5.15 seconds to snapshot the instance on the hypervisor.
Apr 14 15:46:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:46:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:26 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:46:26 user nova-compute[71500]: INFO nova.compute.claims [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Claim successful on node user
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:46:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:46:27 user nova-compute[71500]: INFO nova.compute.claims [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Claim successful on node user
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.policy [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:46:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Creating image(s)
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk 1073741824" returned: 0 in 0.221s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.880s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Cannot resize image /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'migration_context' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Ensure instance console log exists: /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:46:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Successfully created port: 9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.policy [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '855c585696694964974a8df948ab7899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1ac7fb012e144cdaa7da36ee9b590a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:46:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Creating image(s)
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "/opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "/opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "/opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "04fbb7029f6ac680673d31a34f0c7fcaf6620872" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "04fbb7029f6ac680673d31a34f0c7fcaf6620872" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Successfully updated port: 9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-changed-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Refreshing instance network info cache due to event network-changed-9a9bcd90-ba38-4399-9896-69b86979911f. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Acquiring lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Acquired lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.network.neutron [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Refreshing network info cache for port 9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.virt.images [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 26e27121-f671-4e7f-8bb6-e13ff6acefb9 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.part /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.network.neutron [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.146s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.part /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.converted" returned: 0 in 0.222s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:29 user nova-compute[71500]: INFO nova.compute.manager [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attaching volume de10ecef-ee3e-4c88-8a81-e05f9b748a1f to /dev/vdb
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "04fbb7029f6ac680673d31a34f0c7fcaf6620872" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.216s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG os_brick.utils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7cc299-1d7c-4011-b4f7-86a99720a4a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:29 user nova-compute[71500]: DEBUG nova.network.neutron [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f728c3-5df4-4474-9f61-037c571fe933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f4860671-7109-48dc-a219-862d73cd1d8c req-4b0e27f9-bf90-407b-8141-62da967418bc service nova] Releasing lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquired lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaeaa94-5cac-4cae-88bf-ed9d7e43e36d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f41b3f4-fa6d-49b0-a153-999ac61663ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 --force-share --output=json" returned: 0 in 0.171s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "04fbb7029f6ac680673d31a34f0c7fcaf6620872" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "04fbb7029f6ac680673d31a34f0c7fcaf6620872" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:46:30 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db32bb-d2bc-4f20-9dad-5e89db0a55e2]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG os_brick.utils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating existing volume attachment record: 51859f30-cdcb-43f1-8492-a06d8174b48f {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 --force-share --output=json" returned: 0 in 0.158s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872,backing_fmt=raw /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872,backing_fmt=raw /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk 1073741824" returned: 0 in 0.063s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "04fbb7029f6ac680673d31a34f0c7fcaf6620872" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 --force-share --output=json" returned: 0 in 0.197s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'migration_context' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Ensure instance console log exists: /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Successfully created port: e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Releasing lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance network_info: |[{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start _get_guest_xml network_info=[{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:46:30 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:30 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'pci_devices' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:46:30 user nova-compute[71500]:   <uuid>d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</uuid>
Apr 14 15:46:30 user nova-compute[71500]:   <name>instance-00000017</name>
Apr 14 15:46:30 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:46:30 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:46:30 user nova-compute[71500]:   <metadata>
Apr 14 15:46:30 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:46:30 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:46:30 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeTestJSON-server-997161815</nova:name>
Apr 14 15:46:30 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:46:30</nova:creationTime>
Apr 14 15:46:30 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:46:30 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:46:30 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:46:30 user nova-compute[71500]:       <nova:owner>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:user uuid="b44feacbb8fa4680a965953c122cf31c">tempest-AttachVolumeTestJSON-1357089397-project-member</nova:user>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:project uuid="534f0fb654694b079fa89150594e1bbb">tempest-AttachVolumeTestJSON-1357089397</nova:project>
Apr 14 15:46:30 user nova-compute[71500]:       </nova:owner>
Apr 14 15:46:30 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:46:30 user nova-compute[71500]:       <nova:ports>
Apr 14 15:46:30 user nova-compute[71500]:         <nova:port uuid="9a9bcd90-ba38-4399-9896-69b86979911f">
Apr 14 15:46:30 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:46:30 user nova-compute[71500]:         </nova:port>
Apr 14 15:46:30 user nova-compute[71500]:       </nova:ports>
Apr 14 15:46:30 user nova-compute[71500]:     </nova:instance>
Apr 14 15:46:30 user nova-compute[71500]:   </metadata>
Apr 14 15:46:30 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:46:30 user nova-compute[71500]:     <system>
Apr 14 15:46:30 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:46:30 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:46:30 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:46:30 user nova-compute[71500]:       <entry name="serial">d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</entry>
Apr 14 15:46:30 user nova-compute[71500]:       <entry name="uuid">d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</entry>
Apr 14 15:46:30 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:46:30 user nova-compute[71500]:     </system>
Apr 14 15:46:30 user nova-compute[71500]:   </sysinfo>
Apr 14 15:46:30 user nova-compute[71500]:   <os>
Apr 14 15:46:30 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:46:30 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:46:30 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:46:30 user nova-compute[71500]:   </os>
Apr 14 15:46:30 user nova-compute[71500]:   <features>
Apr 14 15:46:30 user nova-compute[71500]:     <acpi/>
Apr 14 15:46:30 user nova-compute[71500]:     <apic/>
Apr 14 15:46:30 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:46:30 user nova-compute[71500]:   </features>
Apr 14 15:46:30 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:46:30 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:46:30 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:46:30 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:46:30 user nova-compute[71500]:   </clock>
Apr 14 15:46:30 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:46:30 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:46:30 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:46:30 user nova-compute[71500]:   </cpu>
Apr 14 15:46:30 user nova-compute[71500]:   <devices>
Apr 14 15:46:30 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:46:30 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:46:30 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk"/>
Apr 14 15:46:30 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:46:30 user nova-compute[71500]:     </disk>
Apr 14 15:46:30 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:46:30 user nova-compute[71500]:       <mac address="fa:16:3e:9f:d5:01"/>
Apr 14 15:46:30 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:46:30 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:46:30 user nova-compute[71500]:       <target dev="tap9a9bcd90-ba"/>
Apr 14 15:46:30 user nova-compute[71500]:     </interface>
Apr 14 15:46:30 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:46:30 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/console.log" append="off"/>
Apr 14 15:46:30 user nova-compute[71500]:     </serial>
Apr 14 15:46:30 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:46:30 user nova-compute[71500]:     <video>
Apr 14 15:46:30 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:46:30 user nova-compute[71500]:     </video>
Apr 14 15:46:30 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:46:30 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:46:30 user nova-compute[71500]:     </rng>
Apr 14 15:46:30 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:46:30 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:46:30 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:46:30 user nova-compute[71500]:     </memballoon>
Apr 14 15:46:30 user nova-compute[71500]:   </devices>
Apr 14 15:46:30 user nova-compute[71500]: </domain>
Apr 14 15:46:30 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG os_vif [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a9bcd90-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a9bcd90-ba, col_values=(('external_ids', {'iface-id': '9a9bcd90-ba38-4399-9896-69b86979911f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:d5:01', 'vm-uuid': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:30 user nova-compute[71500]: INFO os_vif [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba')
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:46:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No VIF found with MAC fa:16:3e:9f:d5:01, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Successfully updated port: e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquired lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-changed-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Refreshing instance network info cache due to event network-changed-e2569358-6e39-46e0-a34b-6f67930a0295. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Acquiring lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating instance_info_cache with network_info: [{"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Releasing lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Instance network_info: |[{"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Acquired lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Refreshing network info cache for port e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Start _get_guest_xml network_info=[{"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='daeffffc836979285dd42f0a3cc319ac',container_format='bare',created_at=2023-04-14T15:46:16Z,direct_url=<?>,disk_format='qcow2',id=26e27121-f671-4e7f-8bb6-e13ff6acefb9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-277783302',owner='d1ac7fb012e144cdaa7da36ee9b590a0',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T15:46:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': '26e27121-f671-4e7f-8bb6-e13ff6acefb9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:32 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:32 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='daeffffc836979285dd42f0a3cc319ac',container_format='bare',created_at=2023-04-14T15:46:16Z,direct_url=<?>,disk_format='qcow2',id=26e27121-f671-4e7f-8bb6-e13ff6acefb9,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-277783302',owner='d1ac7fb012e144cdaa7da36ee9b590a0',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T15:46:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-91157443',display_name='tempest-TestStampPattern-server-91157443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-91157443',id=24,image_ref='26e27121-f671-4e7f-8bb6-e13ff6acefb9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q==',key_name='tempest-TestStampPattern-1517680664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1ac7fb012e144cdaa7da36ee9b590a0',ramdisk_id='',reservation_id='r-9b4slgyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='203e4039-aa71-4521-8e74-02452436cb60',image_min_disk='1',image_min_ram='0',image_owner_id='d1ac7fb012e144cdaa7da36ee9b590a0',image_owner_project_name='tempest-TestStampPattern-2099461179',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2099461179-project-member',image_user_id='855c585696694964974a8df948ab7899',network_allocated='True',owner_project_name='tempest-TestStampPattern-2099461179',owner_user_name='tempest-TestStampPattern-2099461179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:46:29Z,user_data=None,user_id='855c585696694964974a8df948ab7899',uuid=af42177f-7597-4b26-8c8b-27f37a044cfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converting VIF {"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.objects.instance [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'pci_devices' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:46:32 user nova-compute[71500]:   <uuid>af42177f-7597-4b26-8c8b-27f37a044cfc</uuid>
Apr 14 15:46:32 user nova-compute[71500]:   <name>instance-00000018</name>
Apr 14 15:46:32 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:46:32 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:46:32 user nova-compute[71500]:   <metadata>
Apr 14 15:46:32 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:46:32 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:46:32 user nova-compute[71500]:       <nova:name>tempest-TestStampPattern-server-91157443</nova:name>
Apr 14 15:46:32 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:46:32</nova:creationTime>
Apr 14 15:46:32 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:46:32 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:46:32 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:46:32 user nova-compute[71500]:       <nova:owner>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:user uuid="855c585696694964974a8df948ab7899">tempest-TestStampPattern-2099461179-project-member</nova:user>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:project uuid="d1ac7fb012e144cdaa7da36ee9b590a0">tempest-TestStampPattern-2099461179</nova:project>
Apr 14 15:46:32 user nova-compute[71500]:       </nova:owner>
Apr 14 15:46:32 user nova-compute[71500]:       <nova:root type="image" uuid="26e27121-f671-4e7f-8bb6-e13ff6acefb9"/>
Apr 14 15:46:32 user nova-compute[71500]:       <nova:ports>
Apr 14 15:46:32 user nova-compute[71500]:         <nova:port uuid="e2569358-6e39-46e0-a34b-6f67930a0295">
Apr 14 15:46:32 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:46:32 user nova-compute[71500]:         </nova:port>
Apr 14 15:46:32 user nova-compute[71500]:       </nova:ports>
Apr 14 15:46:32 user nova-compute[71500]:     </nova:instance>
Apr 14 15:46:32 user nova-compute[71500]:   </metadata>
Apr 14 15:46:32 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:46:32 user nova-compute[71500]:     <system>
Apr 14 15:46:32 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:46:32 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:46:32 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:46:32 user nova-compute[71500]:       <entry name="serial">af42177f-7597-4b26-8c8b-27f37a044cfc</entry>
Apr 14 15:46:32 user nova-compute[71500]:       <entry name="uuid">af42177f-7597-4b26-8c8b-27f37a044cfc</entry>
Apr 14 15:46:32 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:46:32 user nova-compute[71500]:     </system>
Apr 14 15:46:32 user nova-compute[71500]:   </sysinfo>
Apr 14 15:46:32 user nova-compute[71500]:   <os>
Apr 14 15:46:32 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:46:32 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:46:32 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:46:32 user nova-compute[71500]:   </os>
Apr 14 15:46:32 user nova-compute[71500]:   <features>
Apr 14 15:46:32 user nova-compute[71500]:     <acpi/>
Apr 14 15:46:32 user nova-compute[71500]:     <apic/>
Apr 14 15:46:32 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:46:32 user nova-compute[71500]:   </features>
Apr 14 15:46:32 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:46:32 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:46:32 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:46:32 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:46:32 user nova-compute[71500]:   </clock>
Apr 14 15:46:32 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:46:32 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:46:32 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:46:32 user nova-compute[71500]:   </cpu>
Apr 14 15:46:32 user nova-compute[71500]:   <devices>
Apr 14 15:46:32 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:46:32 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:46:32 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk"/>
Apr 14 15:46:32 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:46:32 user nova-compute[71500]:     </disk>
Apr 14 15:46:32 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:46:32 user nova-compute[71500]:       <mac address="fa:16:3e:40:74:fe"/>
Apr 14 15:46:32 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:46:32 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:46:32 user nova-compute[71500]:       <target dev="tape2569358-6e"/>
Apr 14 15:46:32 user nova-compute[71500]:     </interface>
Apr 14 15:46:32 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:46:32 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/console.log" append="off"/>
Apr 14 15:46:32 user nova-compute[71500]:     </serial>
Apr 14 15:46:32 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:46:32 user nova-compute[71500]:     <video>
Apr 14 15:46:32 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:46:32 user nova-compute[71500]:     </video>
Apr 14 15:46:32 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:46:32 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:46:32 user nova-compute[71500]:     </rng>
Apr 14 15:46:32 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:46:32 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:46:32 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:46:32 user nova-compute[71500]:     </memballoon>
Apr 14 15:46:32 user nova-compute[71500]:   </devices>
Apr 14 15:46:32 user nova-compute[71500]: </domain>
Apr 14 15:46:32 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-91157443',display_name='tempest-TestStampPattern-server-91157443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-91157443',id=24,image_ref='26e27121-f671-4e7f-8bb6-e13ff6acefb9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q==',key_name='tempest-TestStampPattern-1517680664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1ac7fb012e144cdaa7da36ee9b590a0',ramdisk_id='',reservation_id='r-9b4slgyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='203e4039-aa71-4521-8e74-02452436cb60',image_min_disk='1',image_min_ram='0',image_owner_id='d1ac7fb012e144cdaa7da36ee9b590a0',image_owner_project_name='tempest-TestStampPattern-2099461179',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2099461179-project-member',image_user_id='855c585696694964974a8df948ab7899',network_allocated='True',owner_project_name='tempest-TestStampPattern-2099461179',owner_user_name='tempest-TestStampPattern-2099461179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:46:29Z,user_data=None,user_id='855c585696694964974a8df948ab7899',uuid=af42177f-7597-4b26-8c8b-27f37a044cfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converting VIF {"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG os_vif [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2569358-6e, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2569358-6e, col_values=(('external_ids', {'iface-id': 'e2569358-6e39-46e0-a34b-6f67930a0295', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:74:fe', 'vm-uuid': 'af42177f-7597-4b26-8c8b-27f37a044cfc'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:32 user nova-compute[71500]: INFO os_vif [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e')
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No VIF found with MAC fa:16:3e:40:74:fe, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:32 user nova-compute[71500]: WARNING nova.compute.manager [req-4d122cfc-3e0a-4e77-b2e8-8dadc278d71a req-1dee9729-a5cc-428c-8bb6-0e10422e32ab service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state building and task_state spawning.
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updated VIF entry in instance network info cache for port e2569358-6e39-46e0-a34b-6f67930a0295. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating instance_info_cache with network_info: [{"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8ae9e02-12ee-4464-ba1b-aabafa0ed9f1 req-711465f6-e00d-4f94-b837-978c2e691721 service nova] Releasing lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: INFO nova.compute.manager [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Terminating instance
Apr 14 15:46:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-unplugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-unplugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-5f9212cd-ea4c-476a-ade8-3f76a2727795 req-479098eb-eb35-485e-a572-7b1d7ed1ba99 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-unplugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:46:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Instance destroyed successfully.
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'resources' on Instance uuid d7088d6e-b443-4c76-8a13-199e0721ea36 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:41:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1381069102',display_name='tempest-TestMinimumBasicScenario-server-1381069102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1381069102',id=18,image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6qHHx+CxaN6D4OE7uOO+Zw9h265eOOsY49enaOyamUK510/z5PjCK1XCp54E7Fnoenf98jTQR5OBhbEdD1bW89dU7GYsg+IZ1bquAjdx3vSGtcm2Tq01+SPNh6cUaujw==',key_name='tempest-TestMinimumBasicScenario-1176689891',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-0olith0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='07f87bf5-ccf2-4c81-8d43-c1a9d8492556',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:43:52Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=d7088d6e-b443-4c76-8a13-199e0721ea36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "address": "fa:16:3e:20:73:6b", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05127b2a-2e", "ovs_interfaceid": "05127b2a-2e86-4f6a-9fb3-9e2be5559bde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG os_vif [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05127b2a-2e, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: INFO os_vif [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:73:6b,bridge_name='br-int',has_traffic_filtering=True,id=05127b2a-2e86-4f6a-9fb3-9e2be5559bde,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05127b2a-2e')
Apr 14 15:46:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Deleting instance files /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36_del
Apr 14 15:46:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Deletion of /opt/stack/data/nova/instances/d7088d6e-b443-4c76-8a13-199e0721ea36_del complete
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:46:34 user nova-compute[71500]: INFO nova.compute.manager [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:34 user nova-compute[71500]: WARNING nova.compute.manager [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state building and task_state spawning.
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] No waiting events found dispatching network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:34 user nova-compute[71500]: WARNING nova.compute.manager [req-fa82d1e7-489a-4efb-aebe-1a94b482aeed req-5b3c12b2-fa9c-4e8e-98e6-681796bd5d72 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received unexpected event network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 for instance with vm_state building and task_state spawning.
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:46:35 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Took 1.22 seconds to deallocate network for instance.
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-9543f9a1-e85b-442c-9f73-8aa1161696bb req-7408fdfe-902e-44ec-aae6-ee8ff2d75178 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-deleted-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Acquiring lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] No waiting events found dispatching network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:35 user nova-compute[71500]: WARNING nova.compute.manager [req-0a27d278-62fd-47c6-95c6-90a925591e4b req-20dbef9b-1b9b-4ae1-92bc-215044238c61 service nova] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Received unexpected event network-vif-plugged-05127b2a-2e86-4f6a-9fb3-9e2be5559bde for instance with vm_state active and task_state deleting.
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kePbDqaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:46:35 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:46:35 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:46:35 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae648d1-1233-4525-9c14-a2f1be5a4b00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:46:35 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8cf33-b033-4601-aff0-ef4f8ed07fec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f] added
Apr 14 15:46:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336b5af-bce9-4b47-a047-7037f0cacf17]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d64458-455c-4ab5-af68-2c323ced858f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kePbDqaT {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kePbDqaT" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe557c-b08d-4349-b81c-3b8ce3185497]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kePbDqaT'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ff677b-8b32-49fd-a48d-bcecbfa5e673]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a43c5c9-ba76-4396-8b9d-7435bd389f3c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:46:35 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:46:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:46:35 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:46:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92619220-ddf4-4963-b335-f8d72109ae64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260]
Apr 14 15:46:35 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260] successful.
Apr 14 15:46:35 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1687b15-1ae8-48ff-aa50-cc3406534afb]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d09f344-c0d4-4761-8b53-3011ec232096]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:46:36 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:46:36 user nova-compute[71500]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f (non-flash)
Apr 14 15:46:36 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:46:36 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:46:36 user nova-compute[71500]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f (non-flash)
Apr 14 15:46:36 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fed033-0c02-4b4e-860f-245d16708bc7]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kePbDqaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.560s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Deleted allocations for instance d7088d6e-b443-4c76-8a13-199e0721ea36
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee30ec1c-8fae-4f80-889e-8e3bf58d98cc tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "d7088d6e-b443-4c76-8a13-199e0721ea36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.300s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487196.671696, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Resumed (Lifecycle Event)
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance spawned successfully.
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487196.6783438, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Started (Lifecycle Event)
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] No waiting events found dispatching network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:46:36 user nova-compute[71500]: WARNING nova.compute.manager [req-5c356bb3-8d32-4af9-b9b5-7fe3db2ce2e5 req-aec03ec0-ca0c-41e8-9140-86ee65b98394 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received unexpected event network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 for instance with vm_state building and task_state spawning.
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Took 9.31 seconds to spawn the instance on the hypervisor.
Apr 14 15:46:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:36 user nova-compute[71500]: INFO nova.compute.manager [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Took 10.17 seconds to build instance.
Apr 14 15:46:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-57f56de4-0f6f-4a61-9fd1-e4603679011c tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.278s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23836313935373261', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836313935373261', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:46:37 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:46:37 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:46:37 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:46:37 user nova-compute[71500]:   <serial>de10ecef-ee3e-4c88-8a81-e05f9b748a1f</serial>
Apr 14 15:46:37 user nova-compute[71500]: </disk>
Apr 14 15:46:37 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487197.1875072, af42177f-7597-4b26-8c8b-27f37a044cfc => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] VM Resumed (Lifecycle Event)
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Instance spawned successfully.
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487197.191307, af42177f-7597-4b26-8c8b-27f37a044cfc => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] VM Started (Lifecycle Event)
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Took 8.62 seconds to spawn the instance on the hypervisor.
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:46:37 user nova-compute[71500]: INFO nova.compute.manager [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Took 9.95 seconds to build instance.
Apr 14 15:46:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-50d76ee2-02d4-4d1d-ade5-da16dad53831 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.059s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No VIF found with MAC fa:16:3e:c3:bc:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:46:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d345f59f-7995-4192-9995-20eac3975c23 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.967s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:39 user nova-compute[71500]: INFO nova.compute.manager [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Detaching volume de10ecef-ee3e-4c88-8a81-e05f9b748a1f
Apr 14 15:46:39 user nova-compute[71500]: INFO nova.virt.block_device [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attempting to driver detach volume de10ecef-ee3e-4c88-8a81-e05f9b748a1f from mountpoint /dev/vdb
Apr 14 15:46:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Attempting to detach device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:46:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:46:39 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:46:39 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:46:39 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:46:39 user nova-compute[71500]:   <serial>de10ecef-ee3e-4c88-8a81-e05f9b748a1f</serial>
Apr 14 15:46:39 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:46:39 user nova-compute[71500]: </disk>
Apr 14 15:46:39 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:46:39 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config.
Apr 14 15:46:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:46:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:46:39 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:46:39 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:46:39 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:46:39 user nova-compute[71500]:   <serial>de10ecef-ee3e-4c88-8a81-e05f9b748a1f</serial>
Apr 14 15:46:39 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:46:39 user nova-compute[71500]: </disk>
Apr 14 15:46:39 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487200.1140401, cc81318c-1157-4832-919a-28cc14431f48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:46:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config.
Apr 14 15:46:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kePbDqaT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:46:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f259e15-6cd9-4e3b-b37b-24d5d7f28648]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:46:40 user nova-compute[71500]: No targets found.
Apr 14 15:46:40 user nova-compute[71500]: iSNS:
Apr 14 15:46:40 user nova-compute[71500]: No targets found.
Apr 14 15:46:40 user nova-compute[71500]: STATIC:
Apr 14 15:46:40 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f
Apr 14 15:46:40 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:46:40 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:46:40 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:46:40 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:46:40 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:46:40 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:46:40 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:46:40 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:46:40 user nova-compute[71500]: FIRMWARE:
Apr 14 15:46:40 user nova-compute[71500]: No targets found.
Apr 14 15:46:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:46:40 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:46:40 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f1aedc-ab12-42f2-b308-2236368e9bb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a98ebda-1158-4219-a1ad-9c1b97adc834]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:46:40 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:46:40 user nova-compute[71500]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f (non-flash)
Apr 14 15:46:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:46:40 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:46:40 user nova-compute[71500]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f (non-flash)
Apr 14 15:46:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf42f65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411f28a-4430-473f-af4a-cde0d6f69de5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba9def-8200-4543-aa5c-14f858a722ef]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ddb941-875c-49e2-92a5-bfa18893f7a9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d5cad-8342-4e2f-81c4-c0b4701dee96]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[28709981-6ddc-4cc1-bb5b-4a0e67f583ac]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d0b445-c975-43f4-9c95-81615dadd59b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260]
Apr 14 15:46:40 user nova-compute[71500]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f, portal: 172.16.0.220,3260] successful.
Apr 14 15:46:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de10ecef-ee3e-4c88-8a81-e05f9b748a1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e241ad61-c8ca-45a7-bdfe-1509e356a847]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== disconnect_volume: return (296ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:46:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:46:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f335307b-6e3b-43dd-b704-a935fc1f519e tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.015s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:46:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:46:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=26.04865264892578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance af42177f-7597-4b26-8c8b-27f37a044cfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:46:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:46:49 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487194.0262725, d7088d6e-b443-4c76-8a13-199e0721ea36 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:46:49 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] VM Stopped (Lifecycle Event)
Apr 14 15:46:49 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5e3f2547-8930-4924-9b6f-0b51f48a7732 None None] [instance: d7088d6e-b443-4c76-8a13-199e0721ea36] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:46:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:46:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing instance network info cache due to event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:11 user nova-compute[71500]: INFO nova.compute.manager [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Attaching volume 11765086-22f8-49da-9ddf-855ca5edd6c5 to /dev/vdb
Apr 14 15:47:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updated VIF entry in instance network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG os_brick.utils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-43a64151-4cf8-487f-97db-e7780e1d1a22 req-cc4e2099-4a38-4263-ae25-a1932360d1f4 service nova] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a97107-d67b-4311-bef3-5f67a100591c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[673427e0-cd01-4a73-a819-a0d90bef97e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[09319a8f-88e9-4764-b1cf-256c0e534295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff6ff4b-2787-4dcd-94a9-7c7d79ba58f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:47:11 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:47:11 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb645fda-1a25-4a11-af75-79c8aebcb65f]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG os_brick.utils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:47:11 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating existing volume attachment record: 729c40c1-2968-47e4-b4a4-7e048544655f {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:47:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:47:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrvCBuKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:47:15 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:47:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:47:15 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:47:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:47:15 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:47:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[061cbfb0-07f6-4b4c-92a3-2a7e5adb69cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:47:15 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:15 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ab996-3128-4449-bbee-693ed4adac12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5] added
Apr 14 15:47:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a40e625-295d-4a1f-9c8c-48b71d6ee556]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9926de-c754-4559-835c-1c39aec80cf3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrvCBuKQ {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HrvCBuKQ" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338b163-b9ca-4eb4-aa6f-6e06ea09d34c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HrvCBuKQ'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5319379e-344e-486c-a12b-98e24a3938a1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d7dd92-4b68-411a-bade-4d14cb970ef7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56bd1fb-df7b-445a-a829-6ec3df6a8b3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260]
Apr 14 15:47:16 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260] successful.
Apr 14 15:47:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69391ee-5565-4529-938c-73e1cd0c752e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1a5437-f756-4f3b-b590-a5058cc34456]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:16 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcbb73a-592e-4393-945e-fcbdcbabaa19]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:16 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrvCBuKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23631626331353039', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631626331353039', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:47:17 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:47:17 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:47:17 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:47:17 user nova-compute[71500]:   <serial>11765086-22f8-49da-9ddf-855ca5edd6c5</serial>
Apr 14 15:47:17 user nova-compute[71500]: </disk>
Apr 14 15:47:17 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:2d:3d:d7, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:47:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fccc05c-4259-49ee-afb6-9b46970f672a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.791s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:18 user nova-compute[71500]: INFO nova.compute.manager [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Rescuing
Apr 14 15:47:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:47:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:47:18 user nova-compute[71500]: DEBUG nova.network.neutron [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:47:19 user nova-compute[71500]: WARNING nova.compute.manager [req-923de20c-1e1f-4837-8bf5-6632c88a2628 req-90dee8c5-d065-420b-bbf8-c463372639c7 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state active and task_state rescuing.
Apr 14 15:47:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance destroyed successfully.
Apr 14 15:47:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Attempting rescue
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71500) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:47:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Creating image(s)
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue" returned: 0 in 0.049s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'migration_context' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Start _get_guest_xml network_info=[{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:2d:3d:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'resources' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'numa_topology' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:20 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:47:20 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-105829218',display_name='tempest-ServerRescueNegativeTestJSON-server-105829218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-105829218',id=21,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpwpHpSgjKFFOfT3sSZFGtHW7aHEqY3D7iHTUwEt+HEW6CaFV/NwHuNuh6qVxkjw80tHEBbK1oT4PIGP9fCBT1gDmfTs67kVNJUEGodNvnDGO8uYB8ceVoLe2Fz/R9eFA==',key_name='tempest-keypair-2069158824',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:45:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-v13126gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:45:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa924fefda1428d81152fd573540f26',uuid=f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:2d:3d:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "vif_mac": "fa:16:3e:2d:3d:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'pci_devices' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:47:20 user nova-compute[71500]:   <uuid>f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72</uuid>
Apr 14 15:47:20 user nova-compute[71500]:   <name>instance-00000015</name>
Apr 14 15:47:20 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:47:20 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:47:20 user nova-compute[71500]:   <metadata>
Apr 14 15:47:20 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:47:20 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:47:20 user nova-compute[71500]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-105829218</nova:name>
Apr 14 15:47:20 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:47:20</nova:creationTime>
Apr 14 15:47:20 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:47:20 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:47:20 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:47:20 user nova-compute[71500]:       <nova:owner>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:user uuid="3fa924fefda1428d81152fd573540f26">tempest-ServerRescueNegativeTestJSON-1174024196-project-member</nova:user>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:project uuid="609ac7b149e14baab270d83a2646fbdf">tempest-ServerRescueNegativeTestJSON-1174024196</nova:project>
Apr 14 15:47:20 user nova-compute[71500]:       </nova:owner>
Apr 14 15:47:20 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:47:20 user nova-compute[71500]:       <nova:ports>
Apr 14 15:47:20 user nova-compute[71500]:         <nova:port uuid="152ccc41-c6f1-40f5-9ea2-0449a4f45748">
Apr 14 15:47:20 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 15:47:20 user nova-compute[71500]:         </nova:port>
Apr 14 15:47:20 user nova-compute[71500]:       </nova:ports>
Apr 14 15:47:20 user nova-compute[71500]:     </nova:instance>
Apr 14 15:47:20 user nova-compute[71500]:   </metadata>
Apr 14 15:47:20 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:47:20 user nova-compute[71500]:     <system>
Apr 14 15:47:20 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:47:20 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:47:20 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:47:20 user nova-compute[71500]:       <entry name="serial">f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72</entry>
Apr 14 15:47:20 user nova-compute[71500]:       <entry name="uuid">f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72</entry>
Apr 14 15:47:20 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:47:20 user nova-compute[71500]:     </system>
Apr 14 15:47:20 user nova-compute[71500]:   </sysinfo>
Apr 14 15:47:20 user nova-compute[71500]:   <os>
Apr 14 15:47:20 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:47:20 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:47:20 user nova-compute[71500]:   </os>
Apr 14 15:47:20 user nova-compute[71500]:   <features>
Apr 14 15:47:20 user nova-compute[71500]:     <acpi/>
Apr 14 15:47:20 user nova-compute[71500]:     <apic/>
Apr 14 15:47:20 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:47:20 user nova-compute[71500]:   </features>
Apr 14 15:47:20 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:47:20 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:47:20 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:47:20 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:47:20 user nova-compute[71500]:   </clock>
Apr 14 15:47:20 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:47:20 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:47:20 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:47:20 user nova-compute[71500]:   </cpu>
Apr 14 15:47:20 user nova-compute[71500]:   <devices>
Apr 14 15:47:20 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:47:20 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:47:20 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue"/>
Apr 14 15:47:20 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:47:20 user nova-compute[71500]:     </disk>
Apr 14 15:47:20 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:47:20 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:47:20 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk"/>
Apr 14 15:47:20 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:47:20 user nova-compute[71500]:     </disk>
Apr 14 15:47:20 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:47:20 user nova-compute[71500]:       <mac address="fa:16:3e:2d:3d:d7"/>
Apr 14 15:47:20 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:47:20 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:47:20 user nova-compute[71500]:       <target dev="tap152ccc41-c6"/>
Apr 14 15:47:20 user nova-compute[71500]:     </interface>
Apr 14 15:47:20 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:47:20 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/console.log" append="off"/>
Apr 14 15:47:20 user nova-compute[71500]:     </serial>
Apr 14 15:47:20 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:47:20 user nova-compute[71500]:     <video>
Apr 14 15:47:20 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:47:20 user nova-compute[71500]:     </video>
Apr 14 15:47:20 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:47:20 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:47:20 user nova-compute[71500]:     </rng>
Apr 14 15:47:20 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:47:20 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:47:20 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:47:20 user nova-compute[71500]:     </memballoon>
Apr 14 15:47:20 user nova-compute[71500]:   </devices>
Apr 14 15:47:20 user nova-compute[71500]: </domain>
Apr 14 15:47:20 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:47:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance destroyed successfully.
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] No VIF found with MAC fa:16:3e:2d:3d:d7, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:47:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:47:21 user nova-compute[71500]: WARNING nova.compute.manager [req-35559e76-53e0-4c7e-b625-5e72ab0fecc1 req-83bd82a5-615d-46d2-920f-a5eae22a16cb service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state active and task_state rescuing.
Apr 14 15:47:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:47:24 user nova-compute[71500]: WARNING nova.compute.manager [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state active and task_state rescuing.
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:47:24 user nova-compute[71500]: WARNING nova.compute.manager [req-ddc9bdd6-9a08-4b75-b993-3d46edd85b42 req-3330509c-775e-4cb5-8c64-674d201d4bf6 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state active and task_state rescuing.
Apr 14 15:47:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487244.1877463, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:47:24 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Resumed (Lifecycle Event)
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-280f258e-3089-412f-8768-887cd32c16d1 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:47:24 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487244.1888177, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:47:24 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Started (Lifecycle Event)
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:47:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:47:27 user nova-compute[71500]: INFO nova.compute.claims [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Claim successful on node user
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:47:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.policy [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e5d615d61ea4b1dafa4207d7b21e2d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d21cbc9fcc74fdd8579bad00a8ba2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:47:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Creating image(s)
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "/opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "/opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "dbd5284ea07f32d0ec14bc022e7616b3aa36cd68" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "dbd5284ea07f32d0ec14bc022e7616b3aa36cd68" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.part --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG nova.virt.images [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 60ef30a0-1876-4fd5-b5e6-0f713900a38d was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.part /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Successfully created port: 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.part /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.converted" returned: 0 in 0.183s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "dbd5284ea07f32d0ec14bc022e7616b3aa36cd68" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.961s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "dbd5284ea07f32d0ec14bc022e7616b3aa36cd68" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "dbd5284ea07f32d0ec14bc022e7616b3aa36cd68" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68,backing_fmt=raw /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68,backing_fmt=raw /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk 1073741824" returned: 0 in 0.048s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "dbd5284ea07f32d0ec14bc022e7616b3aa36cd68" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Successfully updated port: 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 --force-share --output=json" returned: 0 in 0.169s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing instance network info cache due to event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Cannot resize image /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'migration_context' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Ensure instance console log exists: /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance network_info: |[{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.neutron [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Start _get_guest_xml network_info=[{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:47:24Z,direct_url=<?>,disk_format='qcow2',id=60ef30a0-1876-4fd5-b5e6-0f713900a38d,min_disk=0,min_ram=0,name='tempest-scenario-img--554961971',owner='6d21cbc9fcc74fdd8579bad00a8ba2eb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:47:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': '60ef30a0-1876-4fd5-b5e6-0f713900a38d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:47:29 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:47:29 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:47:24Z,direct_url=<?>,disk_format='qcow2',id=60ef30a0-1876-4fd5-b5e6-0f713900a38d,min_disk=0,min_ram=0,name='tempest-scenario-img--554961971',owner='6d21cbc9fcc74fdd8579bad00a8ba2eb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:47:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1963605977',display_name='tempest-TestMinimumBasicScenario-server-1963605977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1963605977',id=25,image_ref='60ef30a0-1876-4fd5-b5e6-0f713900a38d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCI6sgJi6SCLfQjKyUtRCtzVQYpURZ2j5LDAaywthgR5+o0GaA3sllz7unMwlMKTrLcOnUHA7Jev2qQMA2hgyH8ueNx1T3M2tGGw3Y5dpWq/0AnTjCeBEu++cIHIIESng==',key_name='tempest-TestMinimumBasicScenario-1135265511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-onzj4n4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='60ef30a0-1876-4fd5-b5e6-0f713900a38d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:47:28Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=9b7be2de-22e0-4639-ae89-856b4cfb17b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:47:29 user nova-compute[71500]:   <uuid>9b7be2de-22e0-4639-ae89-856b4cfb17b4</uuid>
Apr 14 15:47:29 user nova-compute[71500]:   <name>instance-00000019</name>
Apr 14 15:47:29 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:47:29 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:47:29 user nova-compute[71500]:   <metadata>
Apr 14 15:47:29 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:47:29 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:47:29 user nova-compute[71500]:       <nova:name>tempest-TestMinimumBasicScenario-server-1963605977</nova:name>
Apr 14 15:47:29 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:47:29</nova:creationTime>
Apr 14 15:47:29 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:47:29 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:47:29 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:47:29 user nova-compute[71500]:       <nova:owner>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:user uuid="4e5d615d61ea4b1dafa4207d7b21e2d5">tempest-TestMinimumBasicScenario-554859149-project-member</nova:user>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:project uuid="6d21cbc9fcc74fdd8579bad00a8ba2eb">tempest-TestMinimumBasicScenario-554859149</nova:project>
Apr 14 15:47:29 user nova-compute[71500]:       </nova:owner>
Apr 14 15:47:29 user nova-compute[71500]:       <nova:root type="image" uuid="60ef30a0-1876-4fd5-b5e6-0f713900a38d"/>
Apr 14 15:47:29 user nova-compute[71500]:       <nova:ports>
Apr 14 15:47:29 user nova-compute[71500]:         <nova:port uuid="70eb36b4-9ffc-491e-aed2-56587d2d6d47">
Apr 14 15:47:29 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 15:47:29 user nova-compute[71500]:         </nova:port>
Apr 14 15:47:29 user nova-compute[71500]:       </nova:ports>
Apr 14 15:47:29 user nova-compute[71500]:     </nova:instance>
Apr 14 15:47:29 user nova-compute[71500]:   </metadata>
Apr 14 15:47:29 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:47:29 user nova-compute[71500]:     <system>
Apr 14 15:47:29 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:47:29 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:47:29 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:47:29 user nova-compute[71500]:       <entry name="serial">9b7be2de-22e0-4639-ae89-856b4cfb17b4</entry>
Apr 14 15:47:29 user nova-compute[71500]:       <entry name="uuid">9b7be2de-22e0-4639-ae89-856b4cfb17b4</entry>
Apr 14 15:47:29 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:47:29 user nova-compute[71500]:     </system>
Apr 14 15:47:29 user nova-compute[71500]:   </sysinfo>
Apr 14 15:47:29 user nova-compute[71500]:   <os>
Apr 14 15:47:29 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:47:29 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:47:29 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:47:29 user nova-compute[71500]:   </os>
Apr 14 15:47:29 user nova-compute[71500]:   <features>
Apr 14 15:47:29 user nova-compute[71500]:     <acpi/>
Apr 14 15:47:29 user nova-compute[71500]:     <apic/>
Apr 14 15:47:29 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:47:29 user nova-compute[71500]:   </features>
Apr 14 15:47:29 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:47:29 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:47:29 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:47:29 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:47:29 user nova-compute[71500]:   </clock>
Apr 14 15:47:29 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:47:29 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:47:29 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:47:29 user nova-compute[71500]:   </cpu>
Apr 14 15:47:29 user nova-compute[71500]:   <devices>
Apr 14 15:47:29 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:47:29 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:47:29 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk"/>
Apr 14 15:47:29 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:47:29 user nova-compute[71500]:     </disk>
Apr 14 15:47:29 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:47:29 user nova-compute[71500]:       <mac address="fa:16:3e:85:99:55"/>
Apr 14 15:47:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:47:29 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:47:29 user nova-compute[71500]:       <target dev="tap70eb36b4-9f"/>
Apr 14 15:47:29 user nova-compute[71500]:     </interface>
Apr 14 15:47:29 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:47:29 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/console.log" append="off"/>
Apr 14 15:47:29 user nova-compute[71500]:     </serial>
Apr 14 15:47:29 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:47:29 user nova-compute[71500]:     <video>
Apr 14 15:47:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:47:29 user nova-compute[71500]:     </video>
Apr 14 15:47:29 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:47:29 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:47:29 user nova-compute[71500]:     </rng>
Apr 14 15:47:29 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:47:29 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:47:29 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:47:29 user nova-compute[71500]:     </memballoon>
Apr 14 15:47:29 user nova-compute[71500]:   </devices>
Apr 14 15:47:29 user nova-compute[71500]: </domain>
Apr 14 15:47:29 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1963605977',display_name='tempest-TestMinimumBasicScenario-server-1963605977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1963605977',id=25,image_ref='60ef30a0-1876-4fd5-b5e6-0f713900a38d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCI6sgJi6SCLfQjKyUtRCtzVQYpURZ2j5LDAaywthgR5+o0GaA3sllz7unMwlMKTrLcOnUHA7Jev2qQMA2hgyH8ueNx1T3M2tGGw3Y5dpWq/0AnTjCeBEu++cIHIIESng==',key_name='tempest-TestMinimumBasicScenario-1135265511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-onzj4n4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='60ef30a0-1876-4fd5-b5e6-0f713900a38d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:47:28Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=9b7be2de-22e0-4639-ae89-856b4cfb17b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG os_vif [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70eb36b4-9f, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70eb36b4-9f, col_values=(('external_ids', {'iface-id': '70eb36b4-9ffc-491e-aed2-56587d2d6d47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:99:55', 'vm-uuid': '9b7be2de-22e0-4639-ae89-856b4cfb17b4'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:29 user nova-compute[71500]: INFO os_vif [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f')
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No VIF found with MAC fa:16:3e:85:99:55, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:47:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updated VIF entry in instance network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:47:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:47:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8213155b-76a5-409c-bdc4-6dd7ff197648 req-4cb17b94-0739-49ff-92fe-c483b7a15f1e service nova] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:47:31 user nova-compute[71500]: WARNING nova.compute.manager [req-b83cd31f-cd0a-49e2-8eb2-95111996b15b req-88487e1d-0d7d-4a31-bbbb-4cd5c4e8f8f8 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state building and task_state spawning.
Apr 14 15:47:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487253.3621962, 9b7be2de-22e0-4639-ae89-856b4cfb17b4 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] VM Resumed (Lifecycle Event)
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance spawned successfully.
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487253.3635612, 9b7be2de-22e0-4639-ae89-856b4cfb17b4 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] VM Started (Lifecycle Event)
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:47:33 user nova-compute[71500]: WARNING nova.compute.manager [req-4cd63a79-b8ca-4900-9dda-e10a4ee0c1ce req-186ec5ce-240b-4cd2-a018-b8cf09860cb9 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state building and task_state spawning.
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Took 6.55 seconds to build instance.
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-1ee36161-718b-4461-a333-a9c72ca94020 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.638s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:33 user nova-compute[71500]: INFO nova.compute.manager [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attaching volume a8afd5e2-ef3f-4729-9701-20b41b3c93a7 to /dev/vdb
Apr 14 15:47:33 user nova-compute[71500]: DEBUG os_brick.utils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8820d6e0-546b-4168-a5ad-c85fee4d16eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f390b-1fd7-4489-a428-bc62a167b74b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1700be98-3bbc-42f5-8189-4705cf39a974]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec71d92-c29a-42af-98bd-6ac831cada34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:47:33 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:47:33 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e9af0-04e1-4e60-9b02-95ab45082a59]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG os_brick.utils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:47:33 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating existing volume attachment record: 10dddaef-5b7b-4e36-88e3-2705cafa2e63 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:47:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [{"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-40b5c2de-9cb2-4bcc-a04a-a4924e51151c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:47:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:47:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:36 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:38 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWJIayfQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:47:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:47:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:47:39 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea5df03-ccc6-4430-a2e0-1fcf8ac51032]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:47:39 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f27c066-b260-4f4b-ae42-15dfe9c043c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7] added
Apr 14 15:47:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cb5eb8-c337-42b4-99be-15c6266f2e5e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2296fd-bc6d-49d1-b544-c86ca4a94598]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWJIayfQ {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWJIayfQ" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a3c1e-63a6-4a20-8e16-b1ca3e763c3e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWJIayfQ'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6f99bf-53d7-40c7-b177-974046027930]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a743dd5c-764b-41d8-b31f-ef3551e1dd90]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0846969-0267-4728-be86-9de33d582084]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260]
Apr 14 15:47:39 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260] successful.
Apr 14 15:47:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2833878-a653-46cb-8049-76ced2e04cfc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b8114e-d1a1-4e0a-b9f3-8f581729a1c7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)
Apr 14 15:47:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb171748-72b5-4755-8833-b79c22bf2983]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:47:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:40 user nova-compute[71500]: INFO nova.compute.manager [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Detaching volume 8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:47:40 user nova-compute[71500]: INFO nova.virt.block_device [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attempting to driver detach volume 8b38580d-ee34-4663-a8dd-8f2e35ffc774 from mountpoint /dev/vdb
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Attempting to detach device vdb from instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:47:40 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:47:40 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:47:40 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:47:40 user nova-compute[71500]:   <serial>8b38580d-ee34-4663-a8dd-8f2e35ffc774</serial>
Apr 14 15:47:40 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 15:47:40 user nova-compute[71500]: </disk>
Apr 14 15:47:40 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:47:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully detached device vdb from instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 from the persistent domain config.
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:47:40 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:47:40 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:47:40 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:47:40 user nova-compute[71500]:   <serial>8b38580d-ee34-4663-a8dd-8f2e35ffc774</serial>
Apr 14 15:47:40 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 15:47:40 user nova-compute[71500]: </disk>
Apr 14 15:47:40 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWJIayfQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23563376664353436', 'path': '/dev/sde'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563376664353436', 'path': '/dev/sde'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:47:40 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:47:40 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:47:40 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:47:40 user nova-compute[71500]:   <serial>a8afd5e2-ef3f-4729-9701-20b41b3c93a7</serial>
Apr 14 15:47:40 user nova-compute[71500]: </disk>
Apr 14 15:47:40 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:47:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No VIF found with MAC fa:16:3e:c3:bc:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-990c066f-5d3f-4089-859e-66d4beae2dfe tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.511s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487261.3380232, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:47:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully detached device vdb from instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 from the live domain config.
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYkMpcna', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:47:41 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[176aa21c-92ea-450e-974a-3c4dfaa81f45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:47:41 user nova-compute[71500]: No targets found.
Apr 14 15:47:41 user nova-compute[71500]: iSNS:
Apr 14 15:47:41 user nova-compute[71500]: No targets found.
Apr 14 15:47:41 user nova-compute[71500]: STATIC:
Apr 14 15:47:41 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:47:41 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:41 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:41 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7
Apr 14 15:47:41 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:41 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:41 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:47:41 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:41 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:41 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774
Apr 14 15:47:41 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:41 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:41 user nova-compute[71500]: FIRMWARE:
Apr 14 15:47:41 user nova-compute[71500]: No targets found.
Apr 14 15:47:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:47:41 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:47:41 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69a831c-d153-465b-acf2-bcca90754d31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0d76fd-e060-4c05-a646-15ce72138f75]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)
Apr 14 15:47:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae020c4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d5c4cf-40c8-4018-9cd5-6e1c03dbef12]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b80af2-a9ee-4029-8d07-94bfea18418e]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d3356-9691-415e-8953-df60f32d2ea3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f3d12d-2a34-47aa-989b-3d5f20a918ba]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a8709-5c9b-4c17-a5af-4f2e1ae7b8d4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5627142-aa4c-4bfd-bf34-7fc82b1dbc0e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260]
Apr 14 15:47:41 user nova-compute[71500]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774, portal: 172.16.0.220,3260] successful.
Apr 14 15:47:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b38580d-ee34-4663-a8dd-8f2e35ffc774 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9b236-ff2f-48f3-80fd-3a5d4f99bd3f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (314ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:41 user nova-compute[71500]: INFO nova.compute.manager [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Detaching volume a8afd5e2-ef3f-4729-9701-20b41b3c93a7
Apr 14 15:47:42 user nova-compute[71500]: INFO nova.virt.block_device [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attempting to driver detach volume a8afd5e2-ef3f-4729-9701-20b41b3c93a7 from mountpoint /dev/vdb
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Attempting to detach device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:47:42 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:47:42 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:47:42 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:47:42 user nova-compute[71500]:   <serial>a8afd5e2-ef3f-4729-9701-20b41b3c93a7</serial>
Apr 14 15:47:42 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:47:42 user nova-compute[71500]: </disk>
Apr 14 15:47:42 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:47:42 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config.
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:47:42 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:47:42 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:47:42 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:47:42 user nova-compute[71500]:   <serial>a8afd5e2-ef3f-4729-9701-20b41b3c93a7</serial>
Apr 14 15:47:42 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:47:42 user nova-compute[71500]: </disk>
Apr 14 15:47:42 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487262.5020318, cc81318c-1157-4832-919a-28cc14431f48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'flavor' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:47:42 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config.
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWJIayfQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:47:42 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff0273-9417-4e92-a5df-0cb5c33188cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:47:42 user nova-compute[71500]: No targets found.
Apr 14 15:47:42 user nova-compute[71500]: iSNS:
Apr 14 15:47:42 user nova-compute[71500]: No targets found.
Apr 14 15:47:42 user nova-compute[71500]: STATIC:
Apr 14 15:47:42 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:47:42 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:42 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:42 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7
Apr 14 15:47:42 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:42 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:42 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:47:42 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:47:42 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:47:42 user nova-compute[71500]: FIRMWARE:
Apr 14 15:47:42 user nova-compute[71500]: No targets found.
Apr 14 15:47:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:47:42 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:47:42 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3e0f0273-330d-47ab-93b1-39cd181b095e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.969s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545899b-bd06-4e05-8e97-c4054721e29d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc69f697-e478-433c-92e8-1de8bfd576bd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:42 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:42 user nova-compute[71500]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)
Apr 14 15:47:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:47:42 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:47:42 user nova-compute[71500]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 (non-flash)
Apr 14 15:47:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae020c4ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7'): ({'sde'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Removing single pathed devices sde {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a773b61-1d1f-4625-b35b-a583ad8ecdcc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a35064-cdfb-426e-a6c8-4a8043fe0dcd]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flushing IO for device /dev/sde {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe75ec8-1b57-44b0-8bf8-cf3decb90019]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b92afd-e9c0-48e0-bba1-1df28d8f0ea9]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf725981-fdb1-4559-90ee-fb5cf49cf392]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[867d7a59-9a40-48f1-875f-a2fc135d9181]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260]
Apr 14 15:47:42 user nova-compute[71500]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7, portal: 172.16.0.220,3260] successful.
Apr 14 15:47:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8afd5e2-ef3f-4729-9701-20b41b3c93a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a1f12-27a0-468b-ae1f-9f25d2ce1223]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== disconnect_volume: return (286ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:47:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:47:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:43 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:47:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3fb787f8-6d79-47c5-9e40-d841a5a266f6 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:48 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:47:48 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.981372833251953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance af42177f-7597-4b26-8c8b-27f37a044cfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.786s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:47:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:47:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:47:52 user nova-compute[71500]: INFO nova.compute.manager [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] instance snapshotting
Apr 14 15:47:52 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Beginning live snapshot process
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json -f qcow2 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json -f qcow2" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp45r788lv/0048e4d64f464cdea84d975f1c09ce5b.delta 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp45r788lv/0048e4d64f464cdea84d975f1c09ce5b.delta 1073741824" returned: 0 in 0.050s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:52 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 15:47:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:47:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71500) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 15:47:54 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 15:47:54 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:47:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp45r788lv/0048e4d64f464cdea84d975f1c09ce5b.delta /opt/stack/data/nova/instances/snapshots/tmp45r788lv/0048e4d64f464cdea84d975f1c09ce5b {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:47:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp45r788lv/0048e4d64f464cdea84d975f1c09ce5b.delta /opt/stack/data/nova/instances/snapshots/tmp45r788lv/0048e4d64f464cdea84d975f1c09ce5b" returned: 0 in 0.208s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:47:54 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Snapshot extracted, beginning image upload
Apr 14 15:47:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Snapshot image upload complete
Apr 14 15:47:56 user nova-compute[71500]: INFO nova.compute.manager [None req-24369eb9-ab23-4704-a9e2-29b6f27b6494 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Took 4.41 seconds to snapshot the instance on the hypervisor.
Apr 14 15:47:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:47:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:17 user nova-compute[71500]: DEBUG nova.compute.manager [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-changed-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:48:17 user nova-compute[71500]: DEBUG nova.compute.manager [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Refreshing instance network info cache due to event network-changed-9a9bcd90-ba38-4399-9896-69b86979911f. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:48:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Acquiring lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:48:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Acquired lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:48:17 user nova-compute[71500]: DEBUG nova.network.neutron [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Refreshing network info cache for port 9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:48:18 user nova-compute[71500]: DEBUG nova.network.neutron [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updated VIF entry in instance network info cache for port 9a9bcd90-ba38-4399-9896-69b86979911f. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:48:18 user nova-compute[71500]: DEBUG nova.network.neutron [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:48:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9d2ee203-266a-45cc-8e2b-7a3c1dbb7943 req-a736488c-4f63-4aa8-9794-e17a97fc92a1 service nova] Releasing lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:48:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-changed-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Refreshing instance network info cache due to event network-changed-e2569358-6e39-46e0-a34b-6f67930a0295. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Acquiring lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Acquired lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Refreshing network info cache for port e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'flavor' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:20 user nova-compute[71500]: INFO nova.compute.manager [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Attaching volume a5e3bd50-3e1a-473e-aef2-013490f04521 to /dev/vdb
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.utils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[90461eec-ca37-434f-b0f1-58ae4f9d1670]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updated VIF entry in instance network info cache for port e2569358-6e39-46e0-a34b-6f67930a0295. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating instance_info_cache with network_info: [{"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[63506dc4-e92a-49da-9952-0fd122c6169a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c394e4c6-330f-47b9-a072-279e15fc0c3e req-1326f283-c870-4b27-8ce9-5dc4990a11c9 service nova] Releasing lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebf3461-9ca5-49b5-a80a-c474f359f497]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a69dc65-bc0b-41c0-8720-c592e41d4d91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:48:20 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe37aaf-c665-40b8-b462-af69ed6d7035]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.utils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating existing volume attachment record: d52b6734-16e7-495a-832f-1173f7e7de91 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:20 user nova-compute[71500]: INFO nova.compute.manager [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Attaching volume 4daa4e7f-db2c-483e-b08d-d0fef5d74897 to /dev/vdb
Apr 14 15:48:20 user nova-compute[71500]: DEBUG os_brick.utils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[74af5ac3-ef63-48a4-ad03-45b8cc197ddc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fdc92-71b1-48df-8433-a76207fe17b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39fdd13-5062-4316-8417-4548844ceead]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b6ab0e-7184-452e-adbc-cf875cb116f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:48:21 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:48:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f1b2a-e433-4302-a4bd-3e976b53b18b]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG os_brick.utils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:21 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating existing volume attachment record: ce96d2fa-3b2d-43f6-80fc-fd3ca39a9b82 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:48:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avEJUiAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:25 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ac5956-5d81-4b96-a324-1be32a6cc9d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:48:25 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e1b69-95c9-4e54-b8e1-62185eeb5bf6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521] added
Apr 14 15:48:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe9ad62-8464-47da-8bd8-b7fbe6ec45e0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb5fd8-27c9-4574-8227-41e859607cf2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avEJUiAn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avEJUiAn" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ffe42-8696-4b7d-a7e4-0f9774f53472]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avEJUiAn'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[006760e1-0a37-4656-80d5-049807d7b858]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f1c73-3c20-4aff-86e1-a74c1e5aaab6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b159d6f1-f35a-4380-8fdf-b25990161b5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260]
Apr 14 15:48:25 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260] successful.
Apr 14 15:48:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f15ae-13ea-45db-bd2f-a5be1c8af9c7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf78d5d6-2bb2-4b4b-b667-e711db7a1848]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3271f609-b174-4eea-9e0e-4fec8f4ff778]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:48:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avEJUiAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23364313566633761', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364313566633761', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.199s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:26 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:26 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'flavor' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3253a2a9-aa6d-46c4-a171-384d42c21ede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:48:26 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:48:26 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:26 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:48:26 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:26 user nova-compute[71500]:   <serial>a5e3bd50-3e1a-473e-aef2-013490f04521</serial>
Apr 14 15:48:26 user nova-compute[71500]: </disk>
Apr 14 15:48:26 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6882ad6-15d1-470d-808a-974650e0f210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897] added
Apr 14 15:48:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29bb9d-aeda-4ed2-83f5-408929f12024]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f432e-d42c-4a89-95d7-8edadaa426c0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OinWfPzX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OinWfPzX" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[026003be-8a2a-4272-8197-70159acbf9e3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OinWfPzX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85e5e9b-85af-4211-914e-7f4f8754dfa6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5819910-bb93-4440-8943-0517295955d9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[747a41ce-c39f-4d8b-ad6f-518e54652f82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]
Apr 14 15:48:27 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.
Apr 14 15:48:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d484de8-2ad2-4bfb-9fdd-6e1ed296ca4c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe4e22-18ae-446f-acaa-e4479b5afc58]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[71988e55-81bc-4053-9d46-a557591d7c61]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] No VIF found with MAC fa:16:3e:40:74:fe, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:48:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2374324c-054d-4677-b14c-6884e36837d6 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.882s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== connect_volume: return (2520ms) {'type': 'block', 'scsi_wwn': '26638663362333538', 'path': '/dev/sde'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638663362333538', 'path': '/dev/sde'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:48:28 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:28 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:48:28 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:28 user nova-compute[71500]:   <serial>4daa4e7f-db2c-483e-b08d-d0fef5d74897</serial>
Apr 14 15:48:28 user nova-compute[71500]: </disk>
Apr 14 15:48:28 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No VIF found with MAC fa:16:3e:9f:d5:01, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:48:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fd3ca8f9-3527-445c-a48d-c0e83a80b49e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.820s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:29 user nova-compute[71500]: INFO nova.compute.manager [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Detaching volume a5e3bd50-3e1a-473e-aef2-013490f04521
Apr 14 15:48:29 user nova-compute[71500]: INFO nova.virt.block_device [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Attempting to driver detach volume a5e3bd50-3e1a-473e-aef2-013490f04521 from mountpoint /dev/vdb
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Attempting to detach device vdb from instance af42177f-7597-4b26-8c8b-27f37a044cfc from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:48:29 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:29 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:48:29 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:29 user nova-compute[71500]:   <serial>a5e3bd50-3e1a-473e-aef2-013490f04521</serial>
Apr 14 15:48:29 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:48:29 user nova-compute[71500]: </disk>
Apr 14 15:48:29 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:48:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully detached device vdb from instance af42177f-7597-4b26-8c8b-27f37a044cfc from the persistent domain config.
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af42177f-7597-4b26-8c8b-27f37a044cfc from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:48:29 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:29 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:48:29 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:29 user nova-compute[71500]:   <serial>a5e3bd50-3e1a-473e-aef2-013490f04521</serial>
Apr 14 15:48:29 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:48:29 user nova-compute[71500]: </disk>
Apr 14 15:48:29 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71500) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487309.623013, af42177f-7597-4b26-8c8b-27f37a044cfc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:48:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully detached device vdb from instance af42177f-7597-4b26-8c8b-27f37a044cfc from the live domain config.
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avEJUiAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:29 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47c12b-e4b7-4863-8543-4c574c62bbb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:48:29 user nova-compute[71500]: No targets found.
Apr 14 15:48:29 user nova-compute[71500]: iSNS:
Apr 14 15:48:29 user nova-compute[71500]: No targets found.
Apr 14 15:48:29 user nova-compute[71500]: STATIC:
Apr 14 15:48:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:48:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:48:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:48:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521
Apr 14 15:48:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:29 user nova-compute[71500]: FIRMWARE:
Apr 14 15:48:29 user nova-compute[71500]: No targets found.
Apr 14 15:48:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:48:29 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:48:29 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26a60df-cc89-452b-8a90-0e7f3af913e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea676aa-4a60-479b-8c79-0ed8b993ae65]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4113250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d916800-6f22-4753-8fb5-9341b2095873]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[047fb4f3-4331-42ef-95df-7dbc7764b695]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e5ffe-5beb-44c3-9bc6-0ab853e1cdc5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29680a8-a1f2-461b-a2e8-2e506c2668ff]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[17de82d2-91a3-4ba3-9931-9d7f700ce765]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:48:29 user nova-compute[71500]: WARNING nova.compute.manager [req-cc79daeb-de97-4ad0-abe4-965d3961682e req-cb59678b-617f-4e82-afa2-7f58fa1ae9dd service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state active and task_state powering-off.
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e9455e-dc5d-4db2-a849-65ddfd39e7f7]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260]
Apr 14 15:48:29 user nova-compute[71500]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521, portal: 172.16.0.220,3260] successful.
Apr 14 15:48:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5e3bd50-3e1a-473e-aef2-013490f04521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f646146-51a5-4bd0-82eb-b23f2cd31ab7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] <== disconnect_volume: return (364ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance destroyed successfully.
Apr 14 15:48:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-745a9380-d0a4-4b04-aef3-6088f6525cfe tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.895s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'flavor' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f46fe0dd-b37d-49ef-8a28-bb48961e68a8 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.861s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:48:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:48:32 user nova-compute[71500]: WARNING nova.compute.manager [req-1e8505c6-3b8d-4aad-ae02-c6974134cfe3 req-bc521390-6994-4006-be42-a7a70f2f139b service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state None.
Apr 14 15:48:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:36 user nova-compute[71500]: INFO nova.compute.manager [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attaching volume bb908beb-7d3a-4fcc-9e37-d2fa96844028 to /dev/vdb
Apr 14 15:48:36 user nova-compute[71500]: DEBUG os_brick.utils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0418f85-c10f-4d42-bf09-a3102e576bd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f99b43-1af2-46c2-804c-632d26c4d5b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30d5764-c19f-449f-b04a-438ef974c288]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e3785-fca4-4903-beb8-0ece4ea7c563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:48:36 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:48:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[87efd7ae-8cea-439f-a6d7-c8032aeec49e]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG os_brick.utils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:36 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating existing volume attachment record: c925bc8b-f868-4ff5-9f2b-c647765e6f40 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:48:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:40 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCKTEJZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:41 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:41 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:41 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa1acd8-8366-4f93-b4ef-6abb7cd151f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:48:41 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f12c64-3b36-4966-a8a5-2908e9c1e086]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028] added
Apr 14 15:48:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc835cbb-27c9-4f61-8dab-e7ccdd0c6231]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41def8e-a02c-410f-b5d7-c54c5b9eb56f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCKTEJZl {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCKTEJZl" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86f17f-544f-4a5b-83b7-f5ce80e3561a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rCKTEJZl'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[621b67aa-b757-4e94-ae61-b87543781e0d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e41fb4a-bfa7-496a-82af-ff426f46f396]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682a2d0-2c09-4121-ae80-7e009b3ac388]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260]
Apr 14 15:48:41 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260] successful.
Apr 14 15:48:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc60f5a6-1b02-4fcf-bfe1-be3cbf428895]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b55416a-7a25-424e-a6e8-982f855135ab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 (non-flash)
Apr 14 15:48:41 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b58c9a0-44c1-466c-9046-d21087242f2d]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:48:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCKTEJZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26631363564353536', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631363564353536', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG nova.objects.instance [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:48:42 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:42 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:48:42 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:42 user nova-compute[71500]:   <serial>bb908beb-7d3a-4fcc-9e37-d2fa96844028</serial>
Apr 14 15:48:42 user nova-compute[71500]: </disk>
Apr 14 15:48:42 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:48:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] No VIF found with MAC fa:16:3e:c3:bc:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:48:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-e20a7bc9-cc96-41c1-b323-a63e05a42df1 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.732s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:44 user nova-compute[71500]: INFO nova.compute.manager [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Detaching volume bb908beb-7d3a-4fcc-9e37-d2fa96844028
Apr 14 15:48:44 user nova-compute[71500]: INFO nova.virt.block_device [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Attempting to driver detach volume bb908beb-7d3a-4fcc-9e37-d2fa96844028 from mountpoint /dev/vdb
Apr 14 15:48:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Attempting to detach device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:48:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:48:44 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:44 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:48:44 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:44 user nova-compute[71500]:   <serial>bb908beb-7d3a-4fcc-9e37-d2fa96844028</serial>
Apr 14 15:48:44 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:48:44 user nova-compute[71500]: </disk>
Apr 14 15:48:44 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:48:44 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the persistent domain config.
Apr 14 15:48:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:48:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:48:44 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:48:44 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:48:44 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:48:44 user nova-compute[71500]:   <serial>bb908beb-7d3a-4fcc-9e37-d2fa96844028</serial>
Apr 14 15:48:44 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:48:44 user nova-compute[71500]: </disk>
Apr 14 15:48:44 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:48:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487325.0923347, cc81318c-1157-4832-919a-28cc14431f48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:48:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully detached device vdb from instance cc81318c-1157-4832-919a-28cc14431f48 from the live domain config.
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCKTEJZl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:48:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbf42cb-a9b5-4741-9502-fca25550c238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:48:45 user nova-compute[71500]: No targets found.
Apr 14 15:48:45 user nova-compute[71500]: iSNS:
Apr 14 15:48:45 user nova-compute[71500]: No targets found.
Apr 14 15:48:45 user nova-compute[71500]: STATIC:
Apr 14 15:48:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:48:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:48:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:48:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028
Apr 14 15:48:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:48:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:48:45 user nova-compute[71500]: FIRMWARE:
Apr 14 15:48:45 user nova-compute[71500]: No targets found.
Apr 14 15:48:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:48:45 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:48:45 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[952f4e11-5a86-4c0a-a27a-810314ecba60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8496b327-a6d6-4760-be94-ada8ca22f1c0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 (non-flash)
Apr 14 15:48:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc18e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdda1ccc-af58-4a69-a0a8-475997b96707]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[87efbeb4-0f3a-4a5a-95e3-5cd671b737bb]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[60327a6a-56c7-4ee5-87aa-3162685f2764]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa86fce-9a2b-44be-b62f-2268017d70b8]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e5444-b27c-4b93-949e-4b1b096cd83f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ecd41-472e-4fc7-8ade-ccf648ffb42b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260]
Apr 14 15:48:45 user nova-compute[71500]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028, portal: 172.16.0.220,3260] successful.
Apr 14 15:48:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb908beb-7d3a-4fcc-9e37-d2fa96844028 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef21bc1-26bc-4951-8bac-bdddd1d3f680]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487310.4206288, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:48:45 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Stopped (Lifecycle Event)
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] <== disconnect_volume: return (340ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74e62b9f-3e01-4a9b-ab5f-9e1c076130aa None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74e62b9f-3e01-4a9b-ab5f-9e1c076130aa None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'flavor' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5e795cc7-a979-4534-b4e0-0b599ff51524 tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.836s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:48:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:48:49 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:48:49 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.92315673828125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance af42177f-7597-4b26-8c8b-27f37a044cfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:48:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:48:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:48:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:48:58 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:48:58 user nova-compute[71500]: INFO nova.compute.claims [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Claim successful on node user
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:48:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:48:59 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:48:59 user nova-compute[71500]: INFO nova.virt.block_device [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Booting with volume-backed-image e3a0daa8-78ae-44af-8756-1fad21c352f3 at /dev/vda
Apr 14 15:48:59 user nova-compute[71500]: DEBUG nova.policy [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efb645d110464e7e85d7c955ee9f3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584a53650c014f87b9622f2011996200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:48:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:49:00 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Successfully created port: 6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Successfully updated port: 6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-changed-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Refreshing instance network info cache due to event network-changed-6105a87c-7cb8-4e8e-ab47-ab8b469b918c. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Acquiring lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updating instance_info_cache with network_info: [{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance network_info: |[{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Acquired lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Refreshing network info cache for port 6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:49:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updated VIF entry in instance network info cache for port 6105a87c-7cb8-4e8e-ab47-ab8b469b918c. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:49:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updating instance_info_cache with network_info: [{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e630f803-0fc1-4930-a866-460e63b0ea05 req-f2d36ec4-be81-4e3c-b026-2665b24b662d service nova] Releasing lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG os_brick.utils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b58496-bff7-4037-8291-363af95fa688]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8859cd-b2fb-4635-b24f-b404339b74c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[67939f1a-cbfd-4005-8df0-8b799a1ac5ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed012c9-97ca-4553-bc04-158506d833ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:05 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:49:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[45de691e-5832-4dce-a95d-fdaf1573f50e]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG os_brick.utils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:05 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updating existing volume attachment record: 81e4ce23-2192-41fb-9105-3c1c5b8c6ca2 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:49:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:09 user nova-compute[71500]: INFO nova.compute.manager [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Unrescuing
Apr 14 15:49:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:09 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:49:10 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Creating image(s)
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Ensure instance console log exists: /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Start _get_guest_xml network_info=[{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '81e4ce23-2192-41fb-9105-3c1c5b8c6ca2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0514ed4d-d911-4d2a-b1eb-8373e72894eb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff266ab6-0eba-47a3-aca3-bdf634954811', 'serial': 'ff266ab6-0eba-47a3-aca3-bdf634954811'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:49:10 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:49:10 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:10 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:10 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:10 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7102208-cec2-49d7-98dd-24a12e1aaddb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:49:10 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc413069-35dc-4e13-8681-8db7aa9e9668]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811] added
Apr 14 15:49:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb440c3-6764-46c0-b39b-c407fbf972c4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e27fea-7ab9-4789-a764-302ef6eeb04d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkzKbrSg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkzKbrSg" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ecbd16-79b3-4cc2-8248-570fa8ca639d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pkzKbrSg'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3633b595-b345-4eb9-a1af-801fc740742d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b54ff5-513b-4165-aec9-e197226886ae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[333cda96-af26-4588-be1a-d7f76c858ec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260]
Apr 14 15:49:10 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260] successful.
Apr 14 15:49:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[924cfc38-8fec-463b-afa1-b708ccae9268]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce9187-0b73-4f96-adc0-e4ca24cf5cf7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:10 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cdb2cc-10e6-4133-943c-de4878d4be81]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:11 user nova-compute[71500]: WARNING nova.compute.manager [req-58189523-eceb-4a17-8f39-2df065c6aaa3 req-bb2cc737-60cf-4478-a2ff-3ab848042f01 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance destroyed successfully.
Apr 14 15:49:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23863336231613963', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863336231613963', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2100453200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2100453200',id=26,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-wraqf480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:48:59Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=0514ed4d-d911-4d2a-b1eb-8373e72894eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.objects.instance [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'pci_devices' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:49:11 user nova-compute[71500]:   <uuid>0514ed4d-d911-4d2a-b1eb-8373e72894eb</uuid>
Apr 14 15:49:11 user nova-compute[71500]:   <name>instance-0000001a</name>
Apr 14 15:49:11 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:49:11 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:49:11 user nova-compute[71500]:   <metadata>
Apr 14 15:49:11 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:49:11 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:49:11 user nova-compute[71500]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2100453200</nova:name>
Apr 14 15:49:11 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:49:10</nova:creationTime>
Apr 14 15:49:11 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:49:11 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:49:11 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:49:11 user nova-compute[71500]:       <nova:owner>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:user uuid="efb645d110464e7e85d7c955ee9f3466">tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member</nova:user>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:project uuid="584a53650c014f87b9622f2011996200">tempest-ServerBootFromVolumeStableRescueTest-756745587</nova:project>
Apr 14 15:49:11 user nova-compute[71500]:       </nova:owner>
Apr 14 15:49:11 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:49:11 user nova-compute[71500]:       <nova:ports>
Apr 14 15:49:11 user nova-compute[71500]:         <nova:port uuid="6105a87c-7cb8-4e8e-ab47-ab8b469b918c">
Apr 14 15:49:11 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 15:49:11 user nova-compute[71500]:         </nova:port>
Apr 14 15:49:11 user nova-compute[71500]:       </nova:ports>
Apr 14 15:49:11 user nova-compute[71500]:     </nova:instance>
Apr 14 15:49:11 user nova-compute[71500]:   </metadata>
Apr 14 15:49:11 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:49:11 user nova-compute[71500]:     <system>
Apr 14 15:49:11 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:49:11 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:49:11 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:49:11 user nova-compute[71500]:       <entry name="serial">0514ed4d-d911-4d2a-b1eb-8373e72894eb</entry>
Apr 14 15:49:11 user nova-compute[71500]:       <entry name="uuid">0514ed4d-d911-4d2a-b1eb-8373e72894eb</entry>
Apr 14 15:49:11 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:49:11 user nova-compute[71500]:     </system>
Apr 14 15:49:11 user nova-compute[71500]:   </sysinfo>
Apr 14 15:49:11 user nova-compute[71500]:   <os>
Apr 14 15:49:11 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:49:11 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:49:11 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:49:11 user nova-compute[71500]:   </os>
Apr 14 15:49:11 user nova-compute[71500]:   <features>
Apr 14 15:49:11 user nova-compute[71500]:     <acpi/>
Apr 14 15:49:11 user nova-compute[71500]:     <apic/>
Apr 14 15:49:11 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:49:11 user nova-compute[71500]:   </features>
Apr 14 15:49:11 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:49:11 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:49:11 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:49:11 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:49:11 user nova-compute[71500]:   </clock>
Apr 14 15:49:11 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:49:11 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:49:11 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:49:11 user nova-compute[71500]:   </cpu>
Apr 14 15:49:11 user nova-compute[71500]:   <devices>
Apr 14 15:49:11 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:49:11 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:49:11 user nova-compute[71500]:       <source dev="/dev/sdd"/>
Apr 14 15:49:11 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:49:11 user nova-compute[71500]:       <serial>ff266ab6-0eba-47a3-aca3-bdf634954811</serial>
Apr 14 15:49:11 user nova-compute[71500]:     </disk>
Apr 14 15:49:11 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:49:11 user nova-compute[71500]:       <mac address="fa:16:3e:8c:f4:b6"/>
Apr 14 15:49:11 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:49:11 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:49:11 user nova-compute[71500]:       <target dev="tap6105a87c-7c"/>
Apr 14 15:49:11 user nova-compute[71500]:     </interface>
Apr 14 15:49:11 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:49:11 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/console.log" append="off"/>
Apr 14 15:49:11 user nova-compute[71500]:     </serial>
Apr 14 15:49:11 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:49:11 user nova-compute[71500]:     <video>
Apr 14 15:49:11 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:49:11 user nova-compute[71500]:     </video>
Apr 14 15:49:11 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:49:11 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:49:11 user nova-compute[71500]:     </rng>
Apr 14 15:49:11 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:49:11 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:49:11 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:49:11 user nova-compute[71500]:     </memballoon>
Apr 14 15:49:11 user nova-compute[71500]:   </devices>
Apr 14 15:49:11 user nova-compute[71500]: </domain>
Apr 14 15:49:11 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2100453200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2100453200',id=26,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-wraqf480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:48:59Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=0514ed4d-d911-4d2a-b1eb-8373e72894eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG os_vif [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6105a87c-7c, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6105a87c-7c, col_values=(('external_ids', {'iface-id': '6105a87c-7cb8-4e8e-ab47-ab8b469b918c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:f4:b6', 'vm-uuid': '0514ed4d-d911-4d2a-b1eb-8373e72894eb'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:11 user nova-compute[71500]: INFO os_vif [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c')
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:49:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No VIF found with MAC fa:16:3e:8c:f4:b6, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:13 user nova-compute[71500]: WARNING nova.compute.manager [req-af37aaa8-30d2-44e8-9b01-d98acdc2c02d req-3c27671d-d56c-4298-9af1-5d018c62f332 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:49:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:14 user nova-compute[71500]: WARNING nova.compute.manager [req-c8c73feb-77e6-45b2-b988-352fb42e2c81 req-f7e86f99-624d-43a3-8507-05c49c4aaf83 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state building and task_state spawning.
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:15 user nova-compute[71500]: WARNING nova.compute.manager [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:49:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:15 user nova-compute[71500]: WARNING nova.compute.manager [req-7937ce7b-19c0-4bb8-bfd8-72cdc38265d7 req-352f7f30-2288-441d-8300-f4fa5106a3e0 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:16 user nova-compute[71500]: WARNING nova.compute.manager [req-dfd571aa-1daa-4bfb-b41d-7a2857af97f2 req-15409fd3-aaa4-426e-b936-a4d3a9065608 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state building and task_state spawning.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487356.5445209, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Resumed (Lifecycle Event)
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance spawned successfully.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487356.5480478, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Started (Lifecycle Event)
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Took 6.49 seconds to spawn the instance on the hypervisor.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487356.7229917, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Resumed (Lifecycle Event)
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5815a8ca-7fe0-4fb1-84c6-30c03fb8ac50 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Took 18.05 seconds to build instance.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92f2e7cf-5447-4054-80a3-5484d6adafb4 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.138s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487356.7276864, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:16 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Started (Lifecycle Event)
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:49:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-changed-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Refreshing instance network info cache due to event network-changed-e2569358-6e39-46e0-a34b-6f67930a0295. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:49:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Acquiring lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Acquired lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:19 user nova-compute[71500]: DEBUG nova.network.neutron [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Refreshing network info cache for port e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:20 user nova-compute[71500]: INFO nova.compute.manager [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Terminating instance
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updated VIF entry in instance network info cache for port e2569358-6e39-46e0-a34b-6f67930a0295. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating instance_info_cache with network_info: [{"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d80645f4-fe59-47a8-9a34-a04ca7b454b2 req-e859e0b8-9400-49ca-b943-32da960e5d38 service nova] Releasing lock "refresh_cache-af42177f-7597-4b26-8c8b-27f37a044cfc" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'flavor' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Instance destroyed successfully.
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'resources' on Instance uuid af42177f-7597-4b26-8c8b-27f37a044cfc {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-91157443',display_name='tempest-TestStampPattern-server-91157443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-91157443',id=24,image_ref='26e27121-f671-4e7f-8bb6-e13ff6acefb9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q==',key_name='tempest-TestStampPattern-1517680664',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1ac7fb012e144cdaa7da36ee9b590a0',ramdisk_id='',reservation_id='r-9b4slgyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='203e4039-aa71-4521-8e74-02452436cb60',image_min_disk='1',image_min_ram='0',image_owner_id='d1ac7fb012e144cdaa7da36ee9b590a0',image_owner_project_name='tempest-TestStampPattern-2099461179',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2099461179-project-member',image_user_id='855c585696694964974a8df948ab7899',owner_project_name='tempest-TestStampPattern-2099461179',owner_user_name='tempest-TestStampPattern-2099461179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:46:37Z,user_data=None,user_id='855c585696694964974a8df948ab7899',uuid=af42177f-7597-4b26-8c8b-27f37a044cfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converting VIF {"id": "e2569358-6e39-46e0-a34b-6f67930a0295", "address": "fa:16:3e:40:74:fe", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2569358-6e", "ovs_interfaceid": "e2569358-6e39-46e0-a34b-6f67930a0295", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG os_vif [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2569358-6e, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:20 user nova-compute[71500]: INFO nova.compute.manager [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Attaching volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 to /dev/vdb
Apr 14 15:49:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:20 user nova-compute[71500]: INFO os_vif [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:74:fe,bridge_name='br-int',has_traffic_filtering=True,id=e2569358-6e39-46e0-a34b-6f67930a0295,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2569358-6e')
Apr 14 15:49:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Deleting instance files /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc_del
Apr 14 15:49:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Deletion of /opt/stack/data/nova/instances/af42177f-7597-4b26-8c8b-27f37a044cfc_del complete
Apr 14 15:49:21 user nova-compute[71500]: DEBUG os_brick.utils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:21 user nova-compute[71500]: INFO nova.compute.manager [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49058c-1c38-4e15-aee0-5e9a4d3d5bc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a0424-fd49-4828-8a8f-61753948ea83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ab71a2-959b-44fd-afc7-4c920d7a8406]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c245c468-b00a-4b0b-818b-61102fc3023a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:21 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d50111-5e6f-41a7-a8d0-0b53f17a412d]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG os_brick.utils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating existing volume attachment record: a8d3cdde-c3aa-4f5a-a212-73985b90965a {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-vif-unplugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] No waiting events found dispatching network-vif-unplugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-vif-unplugged-e2569358-6e39-46e0-a34b-6f67930a0295 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Acquiring lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] No waiting events found dispatching network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:21 user nova-compute[71500]: WARNING nova.compute.manager [req-d644884b-0e48-4cfa-9682-db86f16daf68 req-748628be-cfc3-49ef-83e8-988cc1267767 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received unexpected event network-vif-plugged-e2569358-6e39-46e0-a34b-6f67930a0295 for instance with vm_state active and task_state deleting.
Apr 14 15:49:22 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Received event network-vif-deleted-e2569358-6e39-46e0-a34b-6f67930a0295 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:22 user nova-compute[71500]: INFO nova.compute.manager [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Neutron deleted interface e2569358-6e39-46e0-a34b-6f67930a0295; detaching it from the instance and deleting it from the info cache
Apr 14 15:49:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:22 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Took 1.07 seconds to deallocate network for instance.
Apr 14 15:49:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-90f5ff3c-3714-4574-b7f9-39fd89092453 req-fc15eb86-d1df-4f05-a7a0-a592eaa3c9f0 service nova] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Detach interface failed, port_id=e2569358-6e39-46e0-a34b-6f67930a0295, reason: Instance af42177f-7597-4b26-8c8b-27f37a044cfc could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:49:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:22 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:49:22 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:49:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:22 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Deleted allocations for instance af42177f-7597-4b26-8c8b-27f37a044cfc
Apr 14 15:49:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-616999a3-7f97-4ea9-aad6-f7b43fab6c69 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "af42177f-7597-4b26-8c8b-27f37a044cfc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.655s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:49:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFbaMksD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:25 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:25 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:49:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7222f2e8-d474-422f-b7fc-27961e72bfc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:49:26 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efa57bf-0942-4c50-a091-a5f19df6dc12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4] added
Apr 14 15:49:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaec9ca-f210-4e11-a339-4aa34f9f6a5d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a01671-5439-4f62-9d0f-45c3779f69b5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFbaMksD {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IFbaMksD" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b6095-91ee-464b-8507-6744f68e79f2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IFbaMksD'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d967770-a86b-425f-8855-c874073b02a4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[74292603-202b-4dc5-ad52-f1a43b43edf2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[513413b7-9712-461a-9df2-c32deeb6839a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260]
Apr 14 15:49:26 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260] successful.
Apr 14 15:49:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[273e6eef-4d31-47f0-91fa-7aaa49fb1009]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10ad83e-b4bf-423a-891a-e3b50121b682]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:26 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a18bf-ae30-4e7b-9f99-ebc4699326a1]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:26 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFbaMksD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23139373730353136', 'path': '/dev/sdf'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139373730353136', 'path': '/dev/sdf'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG nova.objects.instance [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'flavor' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:49:27 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:49:27 user nova-compute[71500]:   <source dev="/dev/sdf"/>
Apr 14 15:49:27 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:49:27 user nova-compute[71500]:   <serial>f18d7393-5cf4-497c-bbe8-b261afa4cfb4</serial>
Apr 14 15:49:27 user nova-compute[71500]: </disk>
Apr 14 15:49:27 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:49:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] No VIF found with MAC fa:16:3e:85:99:55, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:49:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-53a1b172-e2d7-4aa4-9619-cff96cc87e9e tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.145s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing instance network info cache due to event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updated VIF entry in instance network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-95684b44-debb-4720-96bc-be45f8f64ea1 req-38f030fb-1ea1-454e-a508-7bb5ef7ca33f service nova] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing instance network info cache due to event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:33 user nova-compute[71500]: INFO nova.compute.manager [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Rebooting instance
Apr 14 15:49:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updated VIF entry in instance network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b40e0d24-0ce6-465a-a8dd-cc55f3c98823 req-b82c94d1-1771-46d7-b32c-e1cd1f68a1d7 service nova] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'flavor' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG nova.network.neutron [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:34 user nova-compute[71500]: INFO nova.compute.manager [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attaching volume 66cf9862-011c-4854-822b-3e74a77e5148 to /dev/vdb
Apr 14 15:49:34 user nova-compute[71500]: DEBUG os_brick.utils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5b419-7ae9-4f56-815b-426b738af623]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c74391e-8a1d-4590-95c0-76315be818cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd56ee7-95d5-494d-9e79-d1ba5d03c4a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4456ab7b-9408-4f76-9ced-0672f0c720e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:34 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:49:34 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ed236-7db1-49d3-a43f-cd80387924ff]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG os_brick.utils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:34 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating existing volume attachment record: f7f74c69-0095-4e33-9431-bf21c82143f1 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:49:35 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487360.8624563, af42177f-7597-4b26-8c8b-27f37a044cfc => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:35 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] VM Stopped (Lifecycle Event)
Apr 14 15:49:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3c263199-b3fa-4942-81ca-1b83c00ed384 None None] [instance: af42177f-7597-4b26-8c8b-27f37a044cfc] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-unplugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-unplugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:37 user nova-compute[71500]: WARNING nova.compute.manager [req-72f0f1ed-34a0-4a3b-b6cb-f2046afeba88 req-84cdb966-2b7d-441a-a865-0cb3ac6dac5d service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-unplugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state active and task_state reboot_started.
Apr 14 15:49:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance shutdown successfully.
Apr 14 15:49:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:39 user nova-compute[71500]: WARNING nova.compute.manager [req-bfe178f1-bea3-4d86-b9ff-d6e7e111e0bf req-362f3173-91e6-4612-a222-004a3409b6d0 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state active and task_state reboot_started.
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:41 user nova-compute[71500]: WARNING nova.compute.manager [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state active and task_state reboot_started.
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:41 user nova-compute[71500]: WARNING nova.compute.manager [req-607d83c6-dfb8-4538-a982-1ad2f65d2974 req-2697ccd5-d417-462b-9411-3a0040402604 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state active and task_state reboot_started.
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 9b7be2de-22e0-4639-ae89-856b4cfb17b4 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487381.546718, 9b7be2de-22e0-4639-ae89-856b4cfb17b4 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] VM Resumed (Lifecycle Event)
Apr 14 15:49:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance running successfully.
Apr 14 15:49:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance soft rebooted successfully.
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:49:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487381.5471253, 9b7be2de-22e0-4639-ae89-856b4cfb17b4 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:49:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] VM Started (Lifecycle Event)
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-242a83f1-598a-4feb-b85c-546415450b3b tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.849s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:42 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:42 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:42 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c49911-b881-4bbe-83e5-1ea1c272deef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:49:42 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[202908e8-0aac-4841-b701-02a6180de490]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148] added
Apr 14 15:49:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f7365d-dff0-4f11-ae23-830652603af6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[db121a98-0dba-4c65-8462-d2c2677057b7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v slQVuHUX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v slQVuHUX" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4c4356-5da7-4ae2-85ff-ecb809c5c989]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'slQVuHUX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eea10f-78e4-4b9a-b2f2-57a93c16ed2f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c5934-aece-4c0a-bd7a-1fc987ce68a2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f8ae8-61e1-41b8-b866-7b2bcbf54735]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]
Apr 14 15:49:42 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.
Apr 14 15:49:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327632b-2989-4e63-a52e-361a2e3936f1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d7cfa-8976-4e11-acf2-d197533b9e69]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:49:42 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('38', '-', '-', 0) found on session 31 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf35ff-2403-4fbd-b6c8-41b0cb9df593]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 31 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:49:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:49:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23062643536353137', 'path': '/dev/sdg'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062643536353137', 'path': '/dev/sdg'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:49:43 user nova-compute[71500]: DEBUG nova.objects.instance [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'flavor' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:49:43 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:49:43 user nova-compute[71500]:   <source dev="/dev/sdg"/>
Apr 14 15:49:43 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:49:43 user nova-compute[71500]:   <serial>66cf9862-011c-4854-822b-3e74a77e5148</serial>
Apr 14 15:49:43 user nova-compute[71500]: </disk>
Apr 14 15:49:43 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:49:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:49:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:49:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:23:f4:2a, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:49:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-0f61b7c1-fcf6-496d-b2c0-73eedecac09f tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.145s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Stashing vm_state: active {{(pid=71500) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_requests' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:49:47 user nova-compute[71500]: INFO nova.compute.claims [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Claim successful on node user
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_devices' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:47 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating resource usage from migration 99520f03-f059-4477-80c8-15490ba7c6fb
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.864s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:48 user nova-compute[71500]: INFO nova.compute.manager [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Migrating
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:48 user nova-compute[71500]: INFO nova.compute.rpcapi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Starting migrate_disk_and_power_off {{(pid=71500) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:49 user nova-compute[71500]: WARNING nova.compute.manager [req-beaa916a-e274-48aa-86bc-f625deed9716 req-6f6afe39-85ed-43a8-b2ea-c56f63c183f0 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state resize_migrating.
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance destroyed successfully.
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a1caf6-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: INFO os_vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:50 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c215bf29-ece0-49b6-a91c-2823e221bfcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:49:50 user nova-compute[71500]: No targets found.
Apr 14 15:49:50 user nova-compute[71500]: iSNS:
Apr 14 15:49:50 user nova-compute[71500]: No targets found.
Apr 14 15:49:50 user nova-compute[71500]: STATIC:
Apr 14 15:49:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4
Apr 14 15:49:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:49:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:49:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:49:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:49:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:49:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:49:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:49:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:49:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:49:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:49:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:49:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:49:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:49:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:49:50 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:49:50 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:49:50 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:49:50 user nova-compute[71500]: FIRMWARE:
Apr 14 15:49:50 user nova-compute[71500]: No targets found.
Apr 14 15:49:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:49:50 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:49:50 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05ae68e-3a1c-4fa4-bfbc-1cfc685e764a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ba30d2-4390-4e97-8fab-2b46ff2b261e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:49:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4110160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148'): ({'sdg'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdg {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b11529d-2589-4861-a35b-4ce97b532d6d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c754964-2cc1-4591-97b6-d0a0bb03f5dd]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdg {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d05221-6e94-4787-81c0-db1c35dd2ab6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[580ac2c4-20db-4fac-b20d-1256440bd81e]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdg have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca033da2-18c0-4795-a751-952a5325dbb0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[06844305-532b-4b5e-81b3-adc5f897410e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]
Apr 14 15:49:50 user nova-compute[71500]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.
Apr 14 15:49:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e2f3e5-3d25-4c65-84a4-62ae4e2bd5a2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (442ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.568s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_resize/disk /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:49:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7639MB free_disk=25.927013397216797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Applying migration context for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 as it has an incoming, in-progress migration 99520f03-f059-4477-80c8-15490ba7c6fb. Migration status is migrating {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 15:49:51 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating resource usage from migration 99520f03-f059-4477-80c8-15490ba7c6fb
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "cp -r /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_resize/disk /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk" returned: 0 in 0.213s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_resize/disk.info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance cc81318c-1157-4832-919a-28cc14431f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 203e4039-aa71-4521-8e74-02452436cb60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Migration 99520f03-f059-4477-80c8-15490ba7c6fb is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=2240MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "cp -r /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_resize/disk.info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk.info" returned: 0 in 0.068s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:49:51 user nova-compute[71500]: WARNING nova.compute.manager [req-15c3e6b6-5b50-4081-af6b-5bc55358d8e3 req-2928f87b-1a3c-4ad4-8566-03aa0b3aa8fd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state resize_migrating.
Apr 14 15:49:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:49:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:49:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:49:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.686s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Port f5a1caf6-baf3-4c27-82c9-aab287c07447 binding to destination host user is already ACTIVE {{(pid=71500) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG os_brick.utils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f3e48-74ed-401d-b5d1-62e70fe02626]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2785f3-54c8-4fbc-9882-3d58ff3eefe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c1831-2697-4774-a8b8-95faf941ceb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bea631f-61d2-4d41-9710-173abdc2256a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:49:55 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:49:55 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd3108-5d01-4df4-978a-bd9f8f54f0d9]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG os_brick.utils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:49:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-changed-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Refreshing instance network info cache due to event network-changed-3f7d69ad-aaff-498b-8862-241238c91a38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Acquiring lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Acquired lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Refreshing network info cache for port 3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updated VIF entry in instance network info cache for port 3f7d69ad-aaff-498b-8862-241238c91a38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating instance_info_cache with network_info: [{"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:49:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-75dfcf52-b46b-4240-b6f0-0a530771b101 req-f2c3b097-5d01-43c5-bf5e-02f94134a077 service nova] Releasing lock "refresh_cache-cc81318c-1157-4832-919a-28cc14431f48" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:49:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:49:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Starting finish_migration {{(pid=71500) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 15:49:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:49:59 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Creating image(s)
Apr 14 15:49:59 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:49:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Cannot resize image /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Ensure instance console log exists: /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start _get_guest_xml network_info=[{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '5be09693-6dd7-4f41-95d4-3db8151aff42', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65', 'attached_at': '2023-04-14T15:50:00.000000', 'detached_at': '', 'volume_id': '66cf9862-011c-4854-822b-3e74a77e5148', 'serial': '66cf9862-011c-4854-822b-3e74a77e5148'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:50:00 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:00 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:34:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:50:00 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:00 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:00 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c44852c-3a65-4481-ae92-18a83ddfa66c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:50:00 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[540bbd5f-9532-4d10-95f1-7e67d0cfd688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148] added
Apr 14 15:50:00 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[40787cc5-ef46-419e-9045-71258d945cde]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4023e06-9d37-4f5c-8121-6f2dcab5b32b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v slQVuHUX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v slQVuHUX" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f1ab58-e7fb-4f70-8016-8d98cbf118a8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'slQVuHUX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62f627b-b8d0-414e-944d-8ea380f3b484]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26926018-48e8-49c1-a125-8c3455d7b1ce]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c63a88-ba38-49ac-943c-63f070e02be9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]
Apr 14 15:50:00 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.
Apr 14 15:50:00 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6646944-1df9-4e7f-a579-b2ffbec6ebe3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd30ce1-e144-413c-b992-b822c35a19b0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:00 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd039466-143b-422b-81d4-af24d2d0169b]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:00 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:01 user nova-compute[71500]: INFO nova.compute.manager [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Terminating instance
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23062643536353137', 'path': '/dev/sdg'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062643536353137', 'path': '/dev/sdg'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:50:01 user nova-compute[71500]:   <uuid>fd224b68-1cc6-48cc-bcfe-a1ce40252e65</uuid>
Apr 14 15:50:01 user nova-compute[71500]:   <name>instance-00000011</name>
Apr 14 15:50:01 user nova-compute[71500]:   <memory>196608</memory>
Apr 14 15:50:01 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:50:01 user nova-compute[71500]:   <metadata>
Apr 14 15:50:01 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:50:01 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:50:01 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-1544279830</nova:name>
Apr 14 15:50:01 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:50:00</nova:creationTime>
Apr 14 15:50:01 user nova-compute[71500]:       <nova:flavor name="m1.micro">
Apr 14 15:50:01 user nova-compute[71500]:         <nova:memory>192</nova:memory>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:50:01 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:50:01 user nova-compute[71500]:       <nova:owner>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:50:01 user nova-compute[71500]:       </nova:owner>
Apr 14 15:50:01 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:50:01 user nova-compute[71500]:       <nova:ports>
Apr 14 15:50:01 user nova-compute[71500]:         <nova:port uuid="f5a1caf6-baf3-4c27-82c9-aab287c07447">
Apr 14 15:50:01 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:50:01 user nova-compute[71500]:         </nova:port>
Apr 14 15:50:01 user nova-compute[71500]:       </nova:ports>
Apr 14 15:50:01 user nova-compute[71500]:     </nova:instance>
Apr 14 15:50:01 user nova-compute[71500]:   </metadata>
Apr 14 15:50:01 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:50:01 user nova-compute[71500]:     <system>
Apr 14 15:50:01 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:50:01 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:50:01 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:50:01 user nova-compute[71500]:       <entry name="serial">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:50:01 user nova-compute[71500]:       <entry name="uuid">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:50:01 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:50:01 user nova-compute[71500]:     </system>
Apr 14 15:50:01 user nova-compute[71500]:   </sysinfo>
Apr 14 15:50:01 user nova-compute[71500]:   <os>
Apr 14 15:50:01 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:50:01 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:50:01 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:50:01 user nova-compute[71500]:   </os>
Apr 14 15:50:01 user nova-compute[71500]:   <features>
Apr 14 15:50:01 user nova-compute[71500]:     <acpi/>
Apr 14 15:50:01 user nova-compute[71500]:     <apic/>
Apr 14 15:50:01 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:50:01 user nova-compute[71500]:   </features>
Apr 14 15:50:01 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:50:01 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:50:01 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:50:01 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:50:01 user nova-compute[71500]:   </clock>
Apr 14 15:50:01 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:50:01 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:50:01 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:50:01 user nova-compute[71500]:   </cpu>
Apr 14 15:50:01 user nova-compute[71500]:   <devices>
Apr 14 15:50:01 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:50:01 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:50:01 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk"/>
Apr 14 15:50:01 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:50:01 user nova-compute[71500]:     </disk>
Apr 14 15:50:01 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:50:01 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:50:01 user nova-compute[71500]:       <source dev="/dev/sdg"/>
Apr 14 15:50:01 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:50:01 user nova-compute[71500]:       <serial>66cf9862-011c-4854-822b-3e74a77e5148</serial>
Apr 14 15:50:01 user nova-compute[71500]:     </disk>
Apr 14 15:50:01 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:50:01 user nova-compute[71500]:       <mac address="fa:16:3e:23:f4:2a"/>
Apr 14 15:50:01 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:50:01 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:50:01 user nova-compute[71500]:       <target dev="tapf5a1caf6-ba"/>
Apr 14 15:50:01 user nova-compute[71500]:     </interface>
Apr 14 15:50:01 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:50:01 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log" append="off"/>
Apr 14 15:50:01 user nova-compute[71500]:     </serial>
Apr 14 15:50:01 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:50:01 user nova-compute[71500]:     <video>
Apr 14 15:50:01 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:50:01 user nova-compute[71500]:     </video>
Apr 14 15:50:01 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:50:01 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:50:01 user nova-compute[71500]:     </rng>
Apr 14 15:50:01 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:50:01 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:50:01 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:50:01 user nova-compute[71500]:     </memballoon>
Apr 14 15:50:01 user nova-compute[71500]:   </devices>
Apr 14 15:50:01 user nova-compute[71500]: </domain>
Apr 14 15:50:01 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:45:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:49:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:23:f4:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG os_vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a1caf6-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5a1caf6-ba, col_values=(('external_ids', {'iface-id': 'f5a1caf6-baf3-4c27-82c9-aab287c07447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:f4:2a', 'vm-uuid': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:01 user nova-compute[71500]: INFO os_vif [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:50:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:23:f4:2a, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-vif-unplugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] No waiting events found dispatching network-vif-unplugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-c45b7321-2b44-41d8-b2d6-59d189942df6 req-21615362-5dab-46d2-be0a-96fa0b545327 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-vif-unplugged-3f7d69ad-aaff-498b-8862-241238c91a38 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:50:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] Instance destroyed successfully.
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.objects.instance [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lazy-loading 'resources' on Instance uuid cc81318c-1157-4832-919a-28cc14431f48 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:43:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1933872661',display_name='tempest-SnapshotDataIntegrityTests-server-1933872661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1933872661',id=19,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFha8odW+z7ISDIuPdSZePdAynxjWLOIGWY2I6lL7a2QwhfFIdZm7ObXMS8bvQTWc0DBFIrcJxz8DhdLKuke9J8N3t2DQvcIs9S9uYys2p7+hpLefYLxHN59XZ9twQcsw==',key_name='tempest-SnapshotDataIntegrityTests-2098361315',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:43:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='737ea257ab5448389bd751841be0fc72',ramdisk_id='',reservation_id='r-huo57pwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1698287900',owner_user_name='tempest-SnapshotDataIntegrityTests-1698287900-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:43:15Z,user_data=None,user_id='4ee063f686de4a9f9e6b5fe1e7ce2c3a',uuid=cc81318c-1157-4832-919a-28cc14431f48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Converting VIF {"id": "3f7d69ad-aaff-498b-8862-241238c91a38", "address": "fa:16:3e:c3:bc:4d", "network": {"id": "aba8209a-8778-4768-a248-62e4ec4c0dba", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1706214186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "737ea257ab5448389bd751841be0fc72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7d69ad-aa", "ovs_interfaceid": "3f7d69ad-aaff-498b-8862-241238c91a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG os_vif [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f7d69ad-aa, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:02 user nova-compute[71500]: INFO os_vif [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:bc:4d,bridge_name='br-int',has_traffic_filtering=True,id=3f7d69ad-aaff-498b-8862-241238c91a38,network=Network(aba8209a-8778-4768-a248-62e4ec4c0dba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7d69ad-aa')
Apr 14 15:50:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Deleting instance files /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48_del
Apr 14 15:50:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Deletion of /opt/stack/data/nova/instances/cc81318c-1157-4832-919a-28cc14431f48_del complete
Apr 14 15:50:02 user nova-compute[71500]: INFO nova.compute.manager [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] [instance: cc81318c-1157-4832-919a-28cc14431f48] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 14 15:50:02 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:50:02 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:50:03 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] Took 0.86 seconds to deallocate network for instance.
Apr 14 15:50:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-2255a441-c0d6-4187-be63-d4505364b6a2 req-eadf6b24-b79e-4a6b-848b-f615edb09982 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-vif-deleted-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:03 user nova-compute[71500]: WARNING nova.compute.manager [req-59f3fabe-c56e-451c-87fc-61a4bdebcbae req-734678bf-e5ac-4429-82e3-5074c925843c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state resize_finish.
Apr 14 15:50:03 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:50:03 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:04 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Deleted allocations for instance cc81318c-1157-4832-919a-28cc14431f48
Apr 14 15:50:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-914fe98b-12d7-4810-b005-31a32076423d tempest-SnapshotDataIntegrityTests-1698287900 tempest-SnapshotDataIntegrityTests-1698287900-project-member] Lock "cc81318c-1157-4832-919a-28cc14431f48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received event network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Acquiring lock "cc81318c-1157-4832-919a-28cc14431f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] Lock "cc81318c-1157-4832-919a-28cc14431f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] No waiting events found dispatching network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:04 user nova-compute[71500]: WARNING nova.compute.manager [req-35fdd187-4402-4dd9-a303-27ace29dd325 req-565dc033-3103-4af9-9bee-b118248117a3 service nova] [instance: cc81318c-1157-4832-919a-28cc14431f48] Received unexpected event network-vif-plugged-3f7d69ad-aaff-498b-8862-241238c91a38 for instance with vm_state deleted and task_state None.
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487390.3361654, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:05 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Stopped (Lifecycle Event)
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-56565c60-e78c-4032-9cf9-8644a46fc528 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487405.6267743, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:05 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Resumed (Lifecycle Event)
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:50:05 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance running successfully.
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Failed to set time: agent not configured {{(pid=71500) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f1951825-2d4a-4de8-a0de-e8cdc3e8541b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] finish_migration finished successfully. {{(pid=71500) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:50:05 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487405.6277714, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:05 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Started (Lifecycle Event)
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:50:05 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:05 user nova-compute[71500]: WARNING nova.compute.manager [req-9502c460-a3a2-4397-bf62-f53a63951653 req-3e719a6f-28bd-44c0-b6c3-86eec3086747 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state resize_finish.
Apr 14 15:50:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:17 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487402.3932672, cc81318c-1157-4832-919a-28cc14431f48 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:17 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: cc81318c-1157-4832-919a-28cc14431f48] VM Stopped (Lifecycle Event)
Apr 14 15:50:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-01adbe21-c0c5-4ad7-ba06-a981ded9ef6b None None] [instance: cc81318c-1157-4832-919a-28cc14431f48] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-changed-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Refreshing instance network info cache due to event network-changed-59970400-49c0-4153-85a7-7b9b9496df26. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Acquiring lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Acquired lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG nova.network.neutron [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Refreshing network info cache for port 59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:18 user nova-compute[71500]: INFO nova.compute.manager [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Terminating instance
Apr 14 15:50:18 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.network.neutron [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updated VIF entry in instance network info cache for port 59970400-49c0-4153-85a7-7b9b9496df26. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.network.neutron [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updating instance_info_cache with network_info: [{"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bcfa1e4e-820e-4327-840a-9f9aae9fe9f7 req-9c0e1e13-01a6-4c77-b67f-e68754b134ee service nova] Releasing lock "refresh_cache-203e4039-aa71-4521-8e74-02452436cb60" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-vif-unplugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] No waiting events found dispatching network-vif-unplugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-1486ac94-a5b8-4768-9d38-4b415b3d62ad req-51cdee38-4e13-4f72-b349-23e714c7d41f service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-vif-unplugged-59970400-49c0-4153-85a7-7b9b9496df26 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Instance destroyed successfully.
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lazy-loading 'resources' on Instance uuid 203e4039-aa71-4521-8e74-02452436cb60 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-915600654',display_name='tempest-TestStampPattern-server-915600654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-915600654',id=20,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4sU0e1aWgzZS4MOB5AT/CZgk6WpHTA+r2izVYI4qYQDQedY8SJh36x9vWqTx80kNrABeizIWC0TbVPD+u2KOJhSvC9hs1DN58Hn4LwYWJ1aMAaGoYLSrV75oncnEyg+Q==',key_name='tempest-TestStampPattern-1517680664',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:43:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1ac7fb012e144cdaa7da36ee9b590a0',ramdisk_id='',reservation_id='r-b7zl1qod',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2099461179',owner_user_name='tempest-TestStampPattern-2099461179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:46:21Z,user_data=None,user_id='855c585696694964974a8df948ab7899',uuid=203e4039-aa71-4521-8e74-02452436cb60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converting VIF {"id": "59970400-49c0-4153-85a7-7b9b9496df26", "address": "fa:16:3e:99:65:56", "network": {"id": "ede18487-777c-44d7-94ad-f2452fbc753e", "bridge": "br-int", "label": "tempest-TestStampPattern-873565441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1ac7fb012e144cdaa7da36ee9b590a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59970400-49", "ovs_interfaceid": "59970400-49c0-4153-85a7-7b9b9496df26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG os_vif [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59970400-49, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:19 user nova-compute[71500]: INFO os_vif [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:65:56,bridge_name='br-int',has_traffic_filtering=True,id=59970400-49c0-4153-85a7-7b9b9496df26,network=Network(ede18487-777c-44d7-94ad-f2452fbc753e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59970400-49')
Apr 14 15:50:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Deleting instance files /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60_del
Apr 14 15:50:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Deletion of /opt/stack/data/nova/instances/203e4039-aa71-4521-8e74-02452436cb60_del complete
Apr 14 15:50:19 user nova-compute[71500]: INFO nova.compute.manager [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 15:50:19 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:50:19 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:50:20 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Took 0.54 seconds to deallocate network for instance.
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-fe8d27b4-c0b9-403e-b86d-a8b911ba299d req-c90a2b8b-b5b0-4d74-b844-b7d912b7a6bb service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-vif-deleted-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:20 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Deleted allocations for instance 203e4039-aa71-4521-8e74-02452436cb60
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquired lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'info_cache' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c8e5e056-eb87-49fe-9e34-be11eb5e0110 tempest-TestStampPattern-2099461179 tempest-TestStampPattern-2099461179-project-member] Lock "203e4039-aa71-4521-8e74-02452436cb60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Releasing lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:50:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance destroyed successfully.
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'resources' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a9bcd90-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:50:21 user nova-compute[71500]: INFO os_vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba')
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:50:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3464076b-6d4a-4f1f-a423-2d1024af9968]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:50:21 user nova-compute[71500]: No targets found.
Apr 14 15:50:21 user nova-compute[71500]: iSNS:
Apr 14 15:50:21 user nova-compute[71500]: No targets found.
Apr 14 15:50:21 user nova-compute[71500]: STATIC:
Apr 14 15:50:21 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4
Apr 14 15:50:21 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:50:21 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:50:21 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:50:21 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:50:21 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:50:21 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:50:21 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:50:21 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:50:21 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:50:21 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:50:21 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:50:21 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:50:21 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:50:21 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:50:21 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:50:21 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:50:21 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:50:21 user nova-compute[71500]: FIRMWARE:
Apr 14 15:50:21 user nova-compute[71500]: No targets found.
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:50:21 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:50:21 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a0cc8-2cd0-4a47-bffd-d91e00c87dd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eec6e1-106e-4cca-af76-faeb91b8eb1f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc671870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897'): ({'sde'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Removing single pathed devices sde {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0d26e9-3cb0-487f-a37c-27dcbada94f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c5a670-d0fe-463b-94fd-7f111273752d]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flushing IO for device /dev/sde {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received event network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Acquiring lock "203e4039-aa71-4521-8e74-02452436cb60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] Lock "203e4039-aa71-4521-8e74-02452436cb60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] No waiting events found dispatching network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:21 user nova-compute[71500]: WARNING nova.compute.manager [req-9a5644c6-6a9e-461b-9f1f-66bb82519355 req-e660ab9f-ea15-496d-a2ea-27a7b759604a service nova] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Received unexpected event network-vif-plugged-59970400-49c0-4153-85a7-7b9b9496df26 for instance with vm_state deleted and task_state None.
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3b315f-f200-4c2e-8aea-dae8b340b4f1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d323a94e-292d-48bd-b184-f8726b71f6ca]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d21817-16a7-4190-9a67-66ae62437eb9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1764d92b-96e0-4620-ab2b-23d8de83406b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]
Apr 14 15:50:21 user nova-compute[71500]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0895c1-a398-4579-a947-6e77e2abd93f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== disconnect_volume: return (324ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start _get_guest_xml network_info=[{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'ce96d2fa-3b2d-43f6-80fc-fd3ca39a9b82', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297', 'attached_at': '', 'detached_at': '', 'volume_id': '4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'serial': '4daa4e7f-db2c-483e-b08d-d0fef5d74897'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'numa_topology' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:21 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:21 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:50:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:21 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:21 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7fcc1-2865-4327-a17a-0c3954bb5ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:50:21 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e042be-41ef-4eca-86b8-2f5fee69f4af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897] added
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8d7344-8d91-4b0a-935b-a09007240ea4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdee3356-16c1-41f8-9eaa-80895819a950]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OinWfPzX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OinWfPzX" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f5bc1-4425-498d-98ae-1a4e3e6cbfaa]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OinWfPzX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b54977-4239-4534-a4c3-e04bed93d46d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca8c18-2aff-4371-9b2e-c1bb7b2ac254]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[02886038-9bea-4be3-8b64-67cc55fe998e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]
Apr 14 15:50:21 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0017348a-7193-4aa4-89df-53097752bd3d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e68df0-2a1a-4aca-80fb-3597c709ad4f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cacc61-d932-4b60-a155-75cfe0210ccc]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:50:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26638663362333538', 'path': '/dev/sde'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638663362333538', 'path': '/dev/sde'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'pci_devices' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:50:22 user nova-compute[71500]:   <uuid>d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</uuid>
Apr 14 15:50:22 user nova-compute[71500]:   <name>instance-00000017</name>
Apr 14 15:50:22 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:50:22 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:50:22 user nova-compute[71500]:   <metadata>
Apr 14 15:50:22 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:50:22 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:50:22 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeTestJSON-server-997161815</nova:name>
Apr 14 15:50:22 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:50:21</nova:creationTime>
Apr 14 15:50:22 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:50:22 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:50:22 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:50:22 user nova-compute[71500]:       <nova:owner>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:user uuid="b44feacbb8fa4680a965953c122cf31c">tempest-AttachVolumeTestJSON-1357089397-project-member</nova:user>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:project uuid="534f0fb654694b079fa89150594e1bbb">tempest-AttachVolumeTestJSON-1357089397</nova:project>
Apr 14 15:50:22 user nova-compute[71500]:       </nova:owner>
Apr 14 15:50:22 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:50:22 user nova-compute[71500]:       <nova:ports>
Apr 14 15:50:22 user nova-compute[71500]:         <nova:port uuid="9a9bcd90-ba38-4399-9896-69b86979911f">
Apr 14 15:50:22 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:50:22 user nova-compute[71500]:         </nova:port>
Apr 14 15:50:22 user nova-compute[71500]:       </nova:ports>
Apr 14 15:50:22 user nova-compute[71500]:     </nova:instance>
Apr 14 15:50:22 user nova-compute[71500]:   </metadata>
Apr 14 15:50:22 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:50:22 user nova-compute[71500]:     <system>
Apr 14 15:50:22 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:50:22 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:50:22 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:50:22 user nova-compute[71500]:       <entry name="serial">d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</entry>
Apr 14 15:50:22 user nova-compute[71500]:       <entry name="uuid">d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</entry>
Apr 14 15:50:22 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:50:22 user nova-compute[71500]:     </system>
Apr 14 15:50:22 user nova-compute[71500]:   </sysinfo>
Apr 14 15:50:22 user nova-compute[71500]:   <os>
Apr 14 15:50:22 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:50:22 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:50:22 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:50:22 user nova-compute[71500]:   </os>
Apr 14 15:50:22 user nova-compute[71500]:   <features>
Apr 14 15:50:22 user nova-compute[71500]:     <acpi/>
Apr 14 15:50:22 user nova-compute[71500]:     <apic/>
Apr 14 15:50:22 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:50:22 user nova-compute[71500]:   </features>
Apr 14 15:50:22 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:50:22 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:50:22 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:50:22 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:50:22 user nova-compute[71500]:   </clock>
Apr 14 15:50:22 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:50:22 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:50:22 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:50:22 user nova-compute[71500]:   </cpu>
Apr 14 15:50:22 user nova-compute[71500]:   <devices>
Apr 14 15:50:22 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:50:22 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:50:22 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk"/>
Apr 14 15:50:22 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:50:22 user nova-compute[71500]:     </disk>
Apr 14 15:50:22 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:50:22 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:50:22 user nova-compute[71500]:       <source dev="/dev/sde"/>
Apr 14 15:50:22 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:50:22 user nova-compute[71500]:       <serial>4daa4e7f-db2c-483e-b08d-d0fef5d74897</serial>
Apr 14 15:50:22 user nova-compute[71500]:     </disk>
Apr 14 15:50:22 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:50:22 user nova-compute[71500]:       <mac address="fa:16:3e:9f:d5:01"/>
Apr 14 15:50:22 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:50:22 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:50:22 user nova-compute[71500]:       <target dev="tap9a9bcd90-ba"/>
Apr 14 15:50:22 user nova-compute[71500]:     </interface>
Apr 14 15:50:22 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:50:22 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/console.log" append="off"/>
Apr 14 15:50:22 user nova-compute[71500]:     </serial>
Apr 14 15:50:22 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:50:22 user nova-compute[71500]:     <video>
Apr 14 15:50:22 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:50:22 user nova-compute[71500]:     </video>
Apr 14 15:50:22 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:50:22 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:50:22 user nova-compute[71500]:     </rng>
Apr 14 15:50:22 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:50:22 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:50:22 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:50:22 user nova-compute[71500]:     </memballoon>
Apr 14 15:50:22 user nova-compute[71500]:   </devices>
Apr 14 15:50:22 user nova-compute[71500]: </domain>
Apr 14 15:50:22 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:50:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Cannot resize image /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'migration_context' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:48:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG os_vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a9bcd90-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a9bcd90-ba, col_values=(('external_ids', {'iface-id': '9a9bcd90-ba38-4399-9896-69b86979911f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:d5:01', 'vm-uuid': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:50:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:23 user nova-compute[71500]: INFO os_vif [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba')
Apr 14 15:50:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:25 user nova-compute[71500]: WARNING nova.compute.manager [req-168f1b4a-979c-4a21-9ce3-3966895a514b req-98826931-a476-4863-80c6-5c63d6502f8f service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state powering-on.
Apr 14 15:50:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487427.1183794, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Resumed (Lifecycle Event)
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:50:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance rebooted successfully.
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5b7e4a7d-6c5f-4a50-97d6-53da412b8710 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:27 user nova-compute[71500]: WARNING nova.compute.manager [req-f9737f2f-0ec7-4f3d-ab3d-7be03fb5a82c req-2ce4081b-95c1-4a35-a34d-dd1dcc085834 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state powering-on.
Apr 14 15:50:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487427.1226208, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Started (Lifecycle Event)
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:50:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:34 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487419.4088814, 203e4039-aa71-4521-8e74-02452436cb60 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:34 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 203e4039-aa71-4521-8e74-02452436cb60] VM Stopped (Lifecycle Event)
Apr 14 15:50:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-45ac3a1c-9406-40ab-a1d6-ceaab0208950 None None] [instance: 203e4039-aa71-4521-8e74-02452436cb60] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:50:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:46 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:49 user nova-compute[71500]: INFO nova.compute.manager [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Rescuing
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG nova.network.neutron [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:50:50 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:50 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=26.014659881591797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Applying migration context for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 as it has an incoming, in-progress migration 99520f03-f059-4477-80c8-15490ba7c6fb. Migration status is finished {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 15:50:50 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating resource usage from migration 99520f03-f059-4477-80c8-15490ba7c6fb
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Migration 99520f03-f059-4477-80c8-15490ba7c6fb is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.network.neutron [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updating instance_info_cache with network_info: [{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:50:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:51 user nova-compute[71500]: WARNING nova.compute.manager [req-bc188a28-6955-4fa0-81d6-aa0f2486b042 req-6f1e8400-885d-4a86-b4ba-4ac19a6335e2 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state active and task_state rescuing.
Apr 14 15:50:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance destroyed successfully.
Apr 14 15:50:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Attempting a stable device rescue
Apr 14 15:50:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71500) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:50:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Creating image(s)
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "/opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "/opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "487efba3ab87d725bb0adce287942e98070bfafc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "487efba3ab87d725bb0adce287942e98070bfafc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG nova.virt.images [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] 475ecb27-c654-4a52-abae-4a9ca316134d was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.part /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.part /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.converted" returned: 0 in 0.353s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "487efba3ab87d725bb0adce287942e98070bfafc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.495s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "487efba3ab87d725bb0adce287942e98070bfafc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "487efba3ab87d725bb0adce287942e98070bfafc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:53 user nova-compute[71500]: WARNING nova.compute.manager [req-7e291551-90a1-47c8-848a-108831fdb41e req-50bf7a4d-a545-4b8c-a9c3-46aeadb728da service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state active and task_state rescuing.
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc,backing_fmt=raw /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc,backing_fmt=raw /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue" returned: 0 in 0.052s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "487efba3ab87d725bb0adce287942e98070bfafc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'migration_context' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Start _get_guest_xml network_info=[{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "vif_mac": "fa:16:3e:8c:f4:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '475ecb27-c654-4a52-abae-4a9ca316134d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '81e4ce23-2192-41fb-9105-3c1c5b8c6ca2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '0514ed4d-d911-4d2a-b1eb-8373e72894eb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff266ab6-0eba-47a3-aca3-bdf634954811', 'serial': 'ff266ab6-0eba-47a3-aca3-bdf634954811'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'resources' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'numa_topology' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:53 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:53 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:50:53 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:53 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:50:53 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5fe409-8c34-49ea-83cb-d13dd068241a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pkzKbrSg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 15:50:53 user nova-compute[71500]: node.name = iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:50:53 user nova-compute[71500]: node.tpgt = -1
Apr 14 15:50:53 user nova-compute[71500]: node.startup = automatic
Apr 14 15:50:53 user nova-compute[71500]: node.leading_login = No
Apr 14 15:50:53 user nova-compute[71500]: iface.iscsi_ifacename = default
Apr 14 15:50:53 user nova-compute[71500]: iface.net_ifacename = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.ipaddress = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.prefix_len = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.hwaddress = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.transport_name = tcp
Apr 14 15:50:53 user nova-compute[71500]: iface.initiatorname = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.vlan_id = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.vlan_priority = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.vlan_state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.iface_num = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.mtu = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.port = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.bootproto = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.subnet_mask = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.gateway = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_alt_client_id = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_dns = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_learn_iqn = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_vendor_id_state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_vendor_id = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.dhcp_slp_da = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.fragmentation = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.gratuitous_arp = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.incoming_forwarding = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.tos_state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.tos = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.ttl = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.delayed_ack = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.tcp_nagle = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.tcp_wsf_state = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.tcp_wsf = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.tcp_timer_scale = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.tcp_timestamp = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.redirect = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.def_task_mgmt_timeout = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.header_digest = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.data_digest = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.immediate_data = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.initial_r2t = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.data_seq_inorder = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.data_pdu_inorder = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.erl = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.max_receive_data_len = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.first_burst_len = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.max_outstanding_r2t = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.max_burst_len = 0
Apr 14 15:50:53 user nova-compute[71500]: iface.chap_auth = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.bidi_chap = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.strict_login_compliance = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.discovery_auth = <empty>
Apr 14 15:50:53 user nova-compute[71500]: iface.discovery_logout = <empty>
Apr 14 15:50:53 user nova-compute[71500]: node.discovery_address = <empty>
Apr 14 15:50:53 user nova-compute[71500]: node.discovery_port = 0
Apr 14 15:50:53 user nova-compute[71500]: node.discovery_type = static
Apr 14 15:50:53 user nova-compute[71500]: node.session.initial_cmdsn = 0
Apr 14 15:50:53 user nova-compute[71500]: node.session.initial_login_retry_max = 8
Apr 14 15:50:53 user nova-compute[71500]: node.session.xmit_thread_priority = -20
Apr 14 15:50:53 user nova-compute[71500]: node.session.cmds_max = 128
Apr 14 15:50:53 user nova-compute[71500]: node.session.queue_depth = 32
Apr 14 15:50:53 user nova-compute[71500]: node.session.nr_sessions = 1
Apr 14 15:50:53 user nova-compute[71500]: node.session.auth.authmethod = CHAP
Apr 14 15:50:53 user nova-compute[71500]: node.session.auth.username = pkzKbrSg
Apr 14 15:50:53 user nova-compute[71500]: node.session.auth.password = ***
Apr 14 15:50:53 user nova-compute[71500]: node.session.auth.username_in = <empty>
Apr 14 15:50:53 user nova-compute[71500]: node.session.auth.password_in = <empty>
Apr 14 15:50:53 user nova-compute[71500]: node.session.auth.chap_algs = MD5
Apr 14 15:50:53 user nova-compute[71500]: node.session.timeo.replacement_timeout = 120
Apr 14 15:50:53 user nova-compute[71500]: node.session.err_timeo.abort_timeout = 15
Apr 14 15:50:53 user nova-compute[71500]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 15:50:53 user nova-compute[71500]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 15:50:53 user nova-compute[71500]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.FastAbort = Yes
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.InitialR2T = No
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.ImmediateData = Yes
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.MaxConnections = 1
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 15:50:53 user nova-compute[71500]: node.session.iscsi.ERL = 0
Apr 14 15:50:53 user nova-compute[71500]: node.session.scan = manual
Apr 14 15:50:53 user nova-compute[71500]: node.session.reopen_max = 0
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].address = 172.16.0.220
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].port = 3260
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].startup = manual
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].tcp.window_size = 524288
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].tcp.type_of_service = 0
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].timeo.logout_timeout = 15
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].timeo.login_timeout = 15
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].timeo.auth_timeout = 45
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].iscsi.DataDigest = None
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].iscsi.IFMarker = No
Apr 14 15:50:53 user nova-compute[71500]: node.conn[0].iscsi.OFMarker = No
Apr 14 15:50:53 user nova-compute[71500]: # END RECORD
Apr 14 15:50:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15141e5-27ee-4a28-850d-569f3a808d84]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7114dde-4a40-4c7a-8f04-517bf1c19d75]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkzKbrSg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkzKbrSg" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebfb38d-1207-4353-b6e6-d52cad49af63]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pkzKbrSg'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a535bc3-4ccd-4ba8-bded-acad94b7ee22]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b366b10a-674f-4767-bcb3-32390e431566]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:50:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e606b9d9-4a31-481b-b3e0-c5b290dc6e0c]: (4, ('0 0 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23863336231613963', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863336231613963', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2100453200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2100453200',id=26,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-wraqf480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:49:17Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=0514ed4d-d911-4d2a-b1eb-8373e72894eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "vif_mac": "fa:16:3e:8c:f4:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "vif_mac": "fa:16:3e:8c:f4:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'pci_devices' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:50:53 user nova-compute[71500]:   <uuid>0514ed4d-d911-4d2a-b1eb-8373e72894eb</uuid>
Apr 14 15:50:53 user nova-compute[71500]:   <name>instance-0000001a</name>
Apr 14 15:50:53 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:50:53 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:50:53 user nova-compute[71500]:   <metadata>
Apr 14 15:50:53 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:50:53 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:50:53 user nova-compute[71500]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2100453200</nova:name>
Apr 14 15:50:53 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:50:53</nova:creationTime>
Apr 14 15:50:53 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:50:53 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:50:53 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:50:53 user nova-compute[71500]:       <nova:owner>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:user uuid="efb645d110464e7e85d7c955ee9f3466">tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member</nova:user>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:project uuid="584a53650c014f87b9622f2011996200">tempest-ServerBootFromVolumeStableRescueTest-756745587</nova:project>
Apr 14 15:50:53 user nova-compute[71500]:       </nova:owner>
Apr 14 15:50:53 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:50:53 user nova-compute[71500]:       <nova:ports>
Apr 14 15:50:53 user nova-compute[71500]:         <nova:port uuid="6105a87c-7cb8-4e8e-ab47-ab8b469b918c">
Apr 14 15:50:53 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 15:50:53 user nova-compute[71500]:         </nova:port>
Apr 14 15:50:53 user nova-compute[71500]:       </nova:ports>
Apr 14 15:50:53 user nova-compute[71500]:     </nova:instance>
Apr 14 15:50:53 user nova-compute[71500]:   </metadata>
Apr 14 15:50:53 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:50:53 user nova-compute[71500]:     <system>
Apr 14 15:50:53 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:50:53 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:50:53 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:50:53 user nova-compute[71500]:       <entry name="serial">0514ed4d-d911-4d2a-b1eb-8373e72894eb</entry>
Apr 14 15:50:53 user nova-compute[71500]:       <entry name="uuid">0514ed4d-d911-4d2a-b1eb-8373e72894eb</entry>
Apr 14 15:50:53 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:50:53 user nova-compute[71500]:     </system>
Apr 14 15:50:53 user nova-compute[71500]:   </sysinfo>
Apr 14 15:50:53 user nova-compute[71500]:   <os>
Apr 14 15:50:53 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:50:53 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:50:53 user nova-compute[71500]:   </os>
Apr 14 15:50:53 user nova-compute[71500]:   <features>
Apr 14 15:50:53 user nova-compute[71500]:     <acpi/>
Apr 14 15:50:53 user nova-compute[71500]:     <apic/>
Apr 14 15:50:53 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:50:53 user nova-compute[71500]:   </features>
Apr 14 15:50:53 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:50:53 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:50:53 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:50:53 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:50:53 user nova-compute[71500]:   </clock>
Apr 14 15:50:53 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:50:53 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:50:53 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:50:53 user nova-compute[71500]:   </cpu>
Apr 14 15:50:53 user nova-compute[71500]:   <devices>
Apr 14 15:50:53 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:50:53 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:50:53 user nova-compute[71500]:       <source dev="/dev/sdd"/>
Apr 14 15:50:53 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:50:53 user nova-compute[71500]:       <serial>ff266ab6-0eba-47a3-aca3-bdf634954811</serial>
Apr 14 15:50:53 user nova-compute[71500]:     </disk>
Apr 14 15:50:53 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:50:53 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:50:53 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue"/>
Apr 14 15:50:53 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:50:53 user nova-compute[71500]:       <boot order="1"/>
Apr 14 15:50:53 user nova-compute[71500]:     </disk>
Apr 14 15:50:53 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:50:53 user nova-compute[71500]:       <mac address="fa:16:3e:8c:f4:b6"/>
Apr 14 15:50:53 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:50:53 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:50:53 user nova-compute[71500]:       <target dev="tap6105a87c-7c"/>
Apr 14 15:50:53 user nova-compute[71500]:     </interface>
Apr 14 15:50:53 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:50:53 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/console.log" append="off"/>
Apr 14 15:50:53 user nova-compute[71500]:     </serial>
Apr 14 15:50:53 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:50:53 user nova-compute[71500]:     <video>
Apr 14 15:50:53 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:50:53 user nova-compute[71500]:     </video>
Apr 14 15:50:53 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:50:53 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:50:53 user nova-compute[71500]:     </rng>
Apr 14 15:50:53 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:50:53 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:50:53 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:50:53 user nova-compute[71500]:     </memballoon>
Apr 14 15:50:53 user nova-compute[71500]:   </devices>
Apr 14 15:50:53 user nova-compute[71500]: </domain>
Apr 14 15:50:53 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:50:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance destroyed successfully.
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] No VIF found with MAC fa:16:3e:8c:f4:b6, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:50:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG nova.compute.manager [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:55 user nova-compute[71500]: DEBUG nova.compute.manager [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:55 user nova-compute[71500]: WARNING nova.compute.manager [req-bbd879bf-45f2-4c35-a4b4-164572127ddd req-e9eff3f4-3ac8-47e0-95e6-031ac2d04159 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state active and task_state rescuing.
Apr 14 15:50:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 0514ed4d-d911-4d2a-b1eb-8373e72894eb due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487457.156027, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:57 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Resumed (Lifecycle Event)
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-80488514-0b41-43fc-b755-c591c02819fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:50:57 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487457.1573977, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:50:57 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Started (Lifecycle Event)
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:50:57 user nova-compute[71500]: WARNING nova.compute.manager [req-a7999146-517a-4d1e-8e49-850adcd449f8 req-a21ba13a-cc24-49d4-8738-1d51bcada84e service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state None.
Apr 14 15:50:57 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:50:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:50:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing instance network info cache due to event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:51:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:02 user nova-compute[71500]: INFO nova.compute.manager [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Detaching volume 11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:51:02 user nova-compute[71500]: INFO nova.virt.block_device [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Attempting to driver detach volume 11765086-22f8-49da-9ddf-855ca5edd6c5 from mountpoint /dev/vdb
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Attempting to detach device vdb from instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:51:02 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:51:02 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:51:02 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:51:02 user nova-compute[71500]:   <serial>11765086-22f8-49da-9ddf-855ca5edd6c5</serial>
Apr 14 15:51:02 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:51:02 user nova-compute[71500]: </disk>
Apr 14 15:51:02 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:51:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully detached device vdb from instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 from the persistent domain config.
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:51:02 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:51:02 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 15:51:02 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:51:02 user nova-compute[71500]:   <serial>11765086-22f8-49da-9ddf-855ca5edd6c5</serial>
Apr 14 15:51:02 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:51:02 user nova-compute[71500]: </disk>
Apr 14 15:51:02 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updated VIF entry in instance network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-59a89b27-af5e-4881-bdea-1142bf0af499 req-5bca2096-37e6-4490-9252-30587a9ff937 service nova] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487462.6932647, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:51:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully detached device vdb from instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 from the live domain config.
Apr 14 15:51:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HrvCBuKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:51:02 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[647295a7-b8cc-401f-bdaa-5270ed7a83ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:51:02 user nova-compute[71500]: No targets found.
Apr 14 15:51:02 user nova-compute[71500]: iSNS:
Apr 14 15:51:02 user nova-compute[71500]: No targets found.
Apr 14 15:51:02 user nova-compute[71500]: STATIC:
Apr 14 15:51:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4
Apr 14 15:51:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:51:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5
Apr 14 15:51:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:51:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:51:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:51:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:02 user nova-compute[71500]: FIRMWARE:
Apr 14 15:51:02 user nova-compute[71500]: No targets found.
Apr 14 15:51:02 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:51:02 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:51:02 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[54431481-402e-462c-92e5-026352921d62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c5691d-f467-45df-9301-72dc4e31f09a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:02 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4111cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb3e365-c045-4867-9285-c4ab56255e96]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f45a50-1a34-4de7-810a-586523adcf3d]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbeb1dc-9b33-4262-a5a4-dc41a27de653]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92946d09-defe-4993-9846-a5a3283c9c99]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3793ad3-8c3f-4651-9e61-e0ba7bf33e62]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a42f4e-a426-48a9-9525-49edc1597e4b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260]
Apr 14 15:51:03 user nova-compute[71500]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5, portal: 172.16.0.220,3260] successful.
Apr 14 15:51:03 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11765086-22f8-49da-9ddf-855ca5edd6c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb0bd54-0497-4cb0-81cf-8af14f1c6838]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] <== disconnect_volume: return (341ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG nova.compute.manager [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing instance network info cache due to event network-changed-152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Acquiring lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Acquired lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Refreshing network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG nova.objects.instance [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'flavor' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a3fee779-7aa0-4b6a-bbc7-b76fedc36b7b tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.785s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:05 user nova-compute[71500]: DEBUG nova.network.neutron [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updated VIF entry in instance network info cache for port 152ccc41-c6f1-40f5-9ea2-0449a4f45748. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:51:05 user nova-compute[71500]: DEBUG nova.network.neutron [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [{"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ddab3c20-d285-4962-8497-2cade21eb614 req-b0395ac6-deaf-4e62-b988-8d803c16c35e service nova] Releasing lock "refresh_cache-f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing instance network info cache due to event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:51:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.network.neutron [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updated VIF entry in instance network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.network.neutron [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2bc7b6f5-6c44-4de4-ab15-eec8c92590bf req-fef19d44-6b34-42ae-b92f-d28129ee9d4b service nova] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:26 user nova-compute[71500]: INFO nova.compute.manager [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Detaching volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4
Apr 14 15:51:26 user nova-compute[71500]: INFO nova.virt.block_device [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Attempting to driver detach volume f18d7393-5cf4-497c-bbe8-b261afa4cfb4 from mountpoint /dev/vdb
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Attempting to detach device vdb from instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:51:26 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:51:26 user nova-compute[71500]:   <source dev="/dev/sdf"/>
Apr 14 15:51:26 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:51:26 user nova-compute[71500]:   <serial>f18d7393-5cf4-497c-bbe8-b261afa4cfb4</serial>
Apr 14 15:51:26 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:51:26 user nova-compute[71500]: </disk>
Apr 14 15:51:26 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:51:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully detached device vdb from instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 from the persistent domain config.
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:51:26 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:51:26 user nova-compute[71500]:   <source dev="/dev/sdf"/>
Apr 14 15:51:26 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:51:26 user nova-compute[71500]:   <serial>f18d7393-5cf4-497c-bbe8-b261afa4cfb4</serial>
Apr 14 15:51:26 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:51:26 user nova-compute[71500]: </disk>
Apr 14 15:51:26 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487486.961702, 9b7be2de-22e0-4639-ae89-856b4cfb17b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:51:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully detached device vdb from instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 from the live domain config.
Apr 14 15:51:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IFbaMksD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:51:26 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:51:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:26 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c43b3d0-efce-498b-8816-e26aa4203f78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:51:27 user nova-compute[71500]: No targets found.
Apr 14 15:51:27 user nova-compute[71500]: iSNS:
Apr 14 15:51:27 user nova-compute[71500]: No targets found.
Apr 14 15:51:27 user nova-compute[71500]: STATIC:
Apr 14 15:51:27 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4
Apr 14 15:51:27 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:27 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:27 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:51:27 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:27 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:27 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:51:27 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:27 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:27 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:51:27 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:27 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:27 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:51:27 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:27 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:27 user nova-compute[71500]: FIRMWARE:
Apr 14 15:51:27 user nova-compute[71500]: No targets found.
Apr 14 15:51:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:51:27 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:51:27 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e88d9e-b28a-4b3f-bad6-4fba6f20f74a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f4ea9-28ca-4831-9fd8-b13604f4bacb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4'): ({'sdf'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Removing single pathed devices sdf {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9897ce4-8317-488b-960d-fa101bdbef19]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cfe92f-5abc-479e-b3b5-d2f37293e205]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Flushing IO for device /dev/sdf {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2d9c1f-7efb-40a5-a0ea-047b896e2438]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33579ee-0d0f-4ec9-93fd-65042641ab68]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] SCSI volumes sdf have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5abe4-93fd-4c7b-a99f-5ec6ae2564ba]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719294f-8d51-4833-acbc-4fd84b27b449]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260]
Apr 14 15:51:27 user nova-compute[71500]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4, portal: 172.16.0.220,3260] successful.
Apr 14 15:51:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f18d7393-5cf4-497c-bbe8-b261afa4cfb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb53f0c-fcc4-46d9-b6cb-842e66e6495e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] <== disconnect_volume: return (304ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing instance network info cache due to event network-changed-70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Acquiring lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Acquired lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:27 user nova-compute[71500]: DEBUG nova.network.neutron [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Refreshing network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:51:28 user nova-compute[71500]: DEBUG nova.network.neutron [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updated VIF entry in instance network info cache for port 70eb36b4-9ffc-491e-aed2-56587d2d6d47. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:51:28 user nova-compute[71500]: DEBUG nova.network.neutron [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [{"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-31bb4854-d6e7-423c-95cd-4fc812d77fc9 req-3c73dbc3-f422-46a8-98ca-164ebdc49d34 service nova] Releasing lock "refresh_cache-9b7be2de-22e0-4639-ae89-856b4cfb17b4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'flavor' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b1ce14d-0aa3-472a-a01c-bce54ffac7bb tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.962s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Port f5a1caf6-baf3-4c27-82c9-aab287c07447 binding to destination host user is already ACTIVE {{(pid=71500) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Creating tmpfile /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/tmpsaf4_r_8 to verify with other compute node that the instance is on the same shared storage. {{(pid=71500) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:51:38 user nova-compute[71500]: WARNING nova.compute.manager [req-69f65540-1ba5-4a71-86cc-8a53f5790709 req-aba3c5a7-04e0-4715-88bd-d0593bf12013 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state resized and task_state resize_reverting.
Apr 14 15:51:38 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance destroyed successfully.
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a1caf6-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:51:38 user nova-compute[71500]: INFO os_vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:51:38 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d25f18-62fe-4d09-9b98-9488192b77ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:51:38 user nova-compute[71500]: No targets found.
Apr 14 15:51:38 user nova-compute[71500]: iSNS:
Apr 14 15:51:38 user nova-compute[71500]: No targets found.
Apr 14 15:51:38 user nova-compute[71500]: STATIC:
Apr 14 15:51:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:51:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:51:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:51:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:38 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:51:38 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:51:38 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:51:38 user nova-compute[71500]: FIRMWARE:
Apr 14 15:51:38 user nova-compute[71500]: No targets found.
Apr 14 15:51:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:51:38 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:51:38 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c44c3-df4a-4cd1-bcad-7e7cb0cbbd51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994fb55-5a97-4091-8548-2615556f2a36]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4111990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148'): ({'sdg'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdg {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9548f90-4511-48fe-9dc2-4e078c0f92cc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a0fcd3-02f3-41c6-97e6-5fa053a9b3fe]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdg {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[910a1438-f387-4de4-aa87-cfb6f64b2a31]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e4478-5341-4c5b-bd66-a43df2a3a555]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdg have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9959c5e-3e42-4eba-b64a-80ad1d51fd19]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9ebd00-4df4-47bf-b1f5-c426dd8e9da5]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]
Apr 14 15:51:38 user nova-compute[71500]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.
Apr 14 15:51:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82c6483-6a6b-411c-ae8d-d289aaaf25b3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (306ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:51:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:51:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'migration_context' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:51:40 user nova-compute[71500]: WARNING nova.compute.manager [req-be19bc49-6cef-431f-86f3-c7c4ad1c3118 req-22872318-eb4a-4a0b-9c06-ffa54054e537 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state resized and task_state resize_reverting.
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.413s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:40 user nova-compute[71500]: INFO nova.compute.manager [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Swapping old allocation on dict_keys(['7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5']) held by migration 99520f03-f059-4477-80c8-15490ba7c6fb for instance
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Overwriting current allocation {'allocations': {'7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5': {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}, 'generation': 30}}, 'project_id': '95e26fa4727e46479d108fe49e225706', 'user_id': '3062186c340a4cfe875d5455b0ace246', 'consumer_generation': 1} on consumer fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:40 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:51:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid d8e21d6b-fc8f-4373-a54f-452ab5fa169c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-fd224b68-1cc6-48cc-bcfe-a1ce40252e65" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG os_brick.utils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3676b7b1-bc3c-40e0-ba46-418da177866f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cefeec-3c73-4b9e-8fbb-5ab0f9dbc1d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0b39bd-b86a-412a-90cf-7492a6d83603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca9c69b-e238-47b5-b42d-2b1b0658caa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:51:42 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2b85ae-48e5-4d08-8467-dd8a55d21718]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG os_brick.utils [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updating instance_info_cache with network_info: [{"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-d8e21d6b-fc8f-4373-a54f-452ab5fa169c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:51:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Starting finish_revert_migration {{(pid=71500) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start _get_guest_xml network_info=[{"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '2c37cdf9-da0f-4856-a73e-1326344e7e3b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65', 'attached_at': '2023-04-14T15:51:47.000000', 'detached_at': '', 'volume_id': '66cf9862-011c-4854-822b-3e74a77e5148', 'serial': '66cf9862-011c-4854-822b-3e74a77e5148'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:51:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:51:46 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:51:46 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:51:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:51:46 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:51:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:51:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:51:46 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:51:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[55809d2d-db9b-4ea8-b419-4e6aa2ffd754]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:51:47 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28f6006-203d-47a2-97bb-961bbb8a7b55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148] added
Apr 14 15:51:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e130934-f07a-4a19-985b-81447c70bd92]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fe038d-93c8-4591-99aa-e336893d6493]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v slQVuHUX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v slQVuHUX" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6b9abc-eed4-4427-ada1-4a5ac89553b2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'slQVuHUX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[425fc99d-9b9e-488e-87e3-e4f9be598ee6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b937d43a-20d4-4ca6-98e5-2ab4f5c721a6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af3dfa-1d4b-4b67-ba42-862c0bbea2d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]
Apr 14 15:51:47 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.
Apr 14 15:51:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d388bf46-42d9-4860-b2de-729af72767c5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8173f8f4-a1ed-4502-87b0-55fb312ddb4a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:51:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4c852-672b-437f-afe3-b1aa47964fc3]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23062643536353137', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062643536353137', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:51:48 user nova-compute[71500]:   <uuid>fd224b68-1cc6-48cc-bcfe-a1ce40252e65</uuid>
Apr 14 15:51:48 user nova-compute[71500]:   <name>instance-00000011</name>
Apr 14 15:51:48 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:51:48 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:51:48 user nova-compute[71500]:   <metadata>
Apr 14 15:51:48 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:51:48 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:51:48 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-1544279830</nova:name>
Apr 14 15:51:48 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:51:46</nova:creationTime>
Apr 14 15:51:48 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:51:48 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:51:48 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:51:48 user nova-compute[71500]:       <nova:owner>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:51:48 user nova-compute[71500]:       </nova:owner>
Apr 14 15:51:48 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:51:48 user nova-compute[71500]:       <nova:ports>
Apr 14 15:51:48 user nova-compute[71500]:         <nova:port uuid="f5a1caf6-baf3-4c27-82c9-aab287c07447">
Apr 14 15:51:48 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 15:51:48 user nova-compute[71500]:         </nova:port>
Apr 14 15:51:48 user nova-compute[71500]:       </nova:ports>
Apr 14 15:51:48 user nova-compute[71500]:     </nova:instance>
Apr 14 15:51:48 user nova-compute[71500]:   </metadata>
Apr 14 15:51:48 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:51:48 user nova-compute[71500]:     <system>
Apr 14 15:51:48 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:51:48 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:51:48 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:51:48 user nova-compute[71500]:       <entry name="serial">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:51:48 user nova-compute[71500]:       <entry name="uuid">fd224b68-1cc6-48cc-bcfe-a1ce40252e65</entry>
Apr 14 15:51:48 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:51:48 user nova-compute[71500]:     </system>
Apr 14 15:51:48 user nova-compute[71500]:   </sysinfo>
Apr 14 15:51:48 user nova-compute[71500]:   <os>
Apr 14 15:51:48 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:51:48 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:51:48 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:51:48 user nova-compute[71500]:   </os>
Apr 14 15:51:48 user nova-compute[71500]:   <features>
Apr 14 15:51:48 user nova-compute[71500]:     <acpi/>
Apr 14 15:51:48 user nova-compute[71500]:     <apic/>
Apr 14 15:51:48 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:51:48 user nova-compute[71500]:   </features>
Apr 14 15:51:48 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:51:48 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:51:48 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:51:48 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:51:48 user nova-compute[71500]:   </clock>
Apr 14 15:51:48 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:51:48 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:51:48 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:51:48 user nova-compute[71500]:   </cpu>
Apr 14 15:51:48 user nova-compute[71500]:   <devices>
Apr 14 15:51:48 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:51:48 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:51:48 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk"/>
Apr 14 15:51:48 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:51:48 user nova-compute[71500]:     </disk>
Apr 14 15:51:48 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:51:48 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:51:48 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 15:51:48 user nova-compute[71500]:       <target dev="vdb" bus="virtio"/>
Apr 14 15:51:48 user nova-compute[71500]:       <serial>66cf9862-011c-4854-822b-3e74a77e5148</serial>
Apr 14 15:51:48 user nova-compute[71500]:     </disk>
Apr 14 15:51:48 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:51:48 user nova-compute[71500]:       <mac address="fa:16:3e:23:f4:2a"/>
Apr 14 15:51:48 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:51:48 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:51:48 user nova-compute[71500]:       <target dev="tapf5a1caf6-ba"/>
Apr 14 15:51:48 user nova-compute[71500]:     </interface>
Apr 14 15:51:48 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:51:48 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/console.log" append="off"/>
Apr 14 15:51:48 user nova-compute[71500]:     </serial>
Apr 14 15:51:48 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:51:48 user nova-compute[71500]:     <video>
Apr 14 15:51:48 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:51:48 user nova-compute[71500]:     </video>
Apr 14 15:51:48 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:51:48 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:51:48 user nova-compute[71500]:     </rng>
Apr 14 15:51:48 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:51:48 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:51:48 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:51:48 user nova-compute[71500]:     </memballoon>
Apr 14 15:51:48 user nova-compute[71500]:   </devices>
Apr 14 15:51:48 user nova-compute[71500]: </domain>
Apr 14 15:51:48 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:51:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG os_vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5a1caf6-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5a1caf6-ba, col_values=(('external_ids', {'iface-id': 'f5a1caf6-baf3-4c27-82c9-aab287c07447', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:f4:2a', 'vm-uuid': 'fd224b68-1cc6-48cc-bcfe-a1ce40252e65'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:48 user nova-compute[71500]: INFO os_vif [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:48 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:51:52 user nova-compute[71500]: WARNING nova.compute.manager [req-6285b08f-f40f-4300-b356-cc25ad2b1688 req-b22131dd-2a93-437d-96d4-54ebccf7b04f service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state resized and task_state resize_reverting.
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:51:52 user nova-compute[71500]: WARNING nova.compute.manager [req-0c064cd9-5d61-4cea-bb51-fd3d1bf371a9 req-8d4acbb2-ab8d-4d28-8190-010d2b8a83fd service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state resized and task_state resize_reverting.
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for fd224b68-1cc6-48cc-bcfe-a1ce40252e65 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487512.0411737, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Resumed (Lifecycle Event)
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:51:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:51:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=25.96196746826172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance running successfully.
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] finish_revert_migration finished successfully. {{(pid=71500) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487512.042124, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Started (Lifecycle Event)
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.compute.manager [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Terminating instance
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:51:52 user nova-compute[71500]: INFO nova.compute.manager [None req-bb46b4c0-c6fa-4980-900b-726b7a280dbc tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance to original state: 'active'
Apr 14 15:51:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-a2de992b-2f11-42b8-bf95-62d1e0eb53ca req-a679b717-3eb0-48ee-beb2-b04e25290150 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-unplugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:51:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Instance destroyed successfully.
Apr 14 15:51:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'resources' on Instance uuid f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-105829218',display_name='tempest-ServerRescueNegativeTestJSON-server-105829218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-105829218',id=21,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpwpHpSgjKFFOfT3sSZFGtHW7aHEqY3D7iHTUwEt+HEW6CaFV/NwHuNuh6qVxkjw80tHEBbK1oT4PIGP9fCBT1gDmfTs67kVNJUEGodNvnDGO8uYB8ceVoLe2Fz/R9eFA==',key_name='tempest-keypair-2069158824',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:47:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-v13126gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa924fefda1428d81152fd573540f26',uuid=f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "address": "fa:16:3e:2d:3d:d7", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap152ccc41-c6", "ovs_interfaceid": "152ccc41-c6f1-40f5-9ea2-0449a4f45748", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG os_vif [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap152ccc41-c6, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:51:53 user nova-compute[71500]: INFO os_vif [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:3d:d7,bridge_name='br-int',has_traffic_filtering=True,id=152ccc41-c6f1-40f5-9ea2-0449a4f45748,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap152ccc41-c6')
Apr 14 15:51:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Deleting instance files /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72_del
Apr 14 15:51:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Deletion of /opt/stack/data/nova/instances/f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72_del complete
Apr 14 15:51:53 user nova-compute[71500]: INFO nova.compute.manager [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 15:51:53 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:51:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:51:54 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Took 0.84 seconds to deallocate network for instance.
Apr 14 15:51:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-f50c2d03-d111-4858-ad48-12e2303b5c14 req-55f29f51-afb9-4ba3-9e20-a1abc8457efe service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-deleted-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:54 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Deleted allocations for instance f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fe4d6d33-166a-489f-99f1-ff2618ac3f72 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.332s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Acquiring lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] Lock "f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:51:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] No waiting events found dispatching network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:51:54 user nova-compute[71500]: WARNING nova.compute.manager [req-9fccb7d4-120b-4df8-af06-6f5e572e0443 req-21eb7956-dc3d-40aa-8906-ede9a171eb44 service nova] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Received unexpected event network-vif-plugged-152ccc41-c6f1-40f5-9ea2-0449a4f45748 for instance with vm_state deleted and task_state None.
Apr 14 15:51:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:51:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:08 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487513.3752828, f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:52:08 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] VM Stopped (Lifecycle Event)
Apr 14 15:52:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-924e4df0-accb-4c91-a17a-9aeb963c4e95 None None] [instance: f0a7fcab-7df4-47b4-9d57-dfcbf0f66e72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Detaching volume 4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:52:11 user nova-compute[71500]: INFO nova.virt.block_device [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Attempting to driver detach volume 4daa4e7f-db2c-483e-b08d-d0fef5d74897 from mountpoint /dev/vdb
Apr 14 15:52:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Attempting to detach device vdb from instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:52:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:52:11 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:52:11 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:52:11 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:52:11 user nova-compute[71500]:   <serial>4daa4e7f-db2c-483e-b08d-d0fef5d74897</serial>
Apr 14 15:52:11 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 15:52:11 user nova-compute[71500]: </disk>
Apr 14 15:52:11 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:52:11 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully detached device vdb from instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 from the persistent domain config.
Apr 14 15:52:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:52:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:52:11 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:52:11 user nova-compute[71500]:   <source dev="/dev/sde"/>
Apr 14 15:52:11 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:52:11 user nova-compute[71500]:   <serial>4daa4e7f-db2c-483e-b08d-d0fef5d74897</serial>
Apr 14 15:52:11 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 15:52:11 user nova-compute[71500]: </disk>
Apr 14 15:52:11 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487532.1173987, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:52:12 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully detached device vdb from instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 from the live domain config.
Apr 14 15:52:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OinWfPzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:52:12 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5244ec9-2056-431d-bd6b-1caf2eaf46af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:52:12 user nova-compute[71500]: No targets found.
Apr 14 15:52:12 user nova-compute[71500]: iSNS:
Apr 14 15:52:12 user nova-compute[71500]: No targets found.
Apr 14 15:52:12 user nova-compute[71500]: STATIC:
Apr 14 15:52:12 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:52:12 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:52:12 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:52:12 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897
Apr 14 15:52:12 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:52:12 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:52:12 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:52:12 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:52:12 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:52:12 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:52:12 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:52:12 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:52:12 user nova-compute[71500]: FIRMWARE:
Apr 14 15:52:12 user nova-compute[71500]: No targets found.
Apr 14 15:52:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:52:12 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:52:12 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4877572c-27cf-4ddf-8e4b-d00f3a097e83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb1dff-061b-4d0d-b3e9-36506156c43a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:52:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc2f3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897'): ({'sde'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Removing single pathed devices sde {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce97323-ea71-4901-9b3e-4ea588a8e9bd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9444e099-9453-4b43-8c05-895997406953]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flushing IO for device /dev/sde {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aab5fd-d4b8-43cd-b460-569b26e66721]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f743af3f-b6c2-4e82-8072-459b1c853f87]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] SCSI volumes sde have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c5fa8d-d63a-462f-861c-929db0209855]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1845288b-e450-46d1-8dd0-0adc564cd6a1]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260]
Apr 14 15:52:12 user nova-compute[71500]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897, portal: 172.16.0.220,3260] successful.
Apr 14 15:52:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daa4e7f-db2c-483e-b08d-d0fef5d74897 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f1585-9a1f-477d-8a31-d5a8017b8c84]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== disconnect_volume: return (314ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:52:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:52:13 user nova-compute[71500]: DEBUG nova.objects.instance [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:52:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a43a105-cff1-448d-93d5-0e83dc1ff97f tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71500) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:14 user nova-compute[71500]: WARNING nova.compute.manager [req-ce6928d5-0af3-499c-b8c1-c451a2849f49 req-62bb5cb7-0ea6-4306-a580-eb1ccabb785b service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state active and task_state powering-off.
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance destroyed successfully.
Apr 14 15:52:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-33bda314-2284-40d4-b61c-c72e3d5848cd tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.875s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:16 user nova-compute[71500]: WARNING nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state None.
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:16 user nova-compute[71500]: WARNING nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state None.
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:16 user nova-compute[71500]: WARNING nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state None.
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:16 user nova-compute[71500]: WARNING nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state None.
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:16 user nova-compute[71500]: WARNING nova.compute.manager [req-01da9b62-1c86-4a68-85a3-825b88ab93a7 req-bcd9ae82-7de2-4532-b86c-ada51ccda4de service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state None.
Apr 14 15:52:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:23 user nova-compute[71500]: INFO nova.compute.manager [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Terminating instance
Apr 14 15:52:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-unplugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-unplugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-d9f4b506-e036-4db6-9240-9f431b4d8717 req-026befb8-0428-4234-8bc3-bff54ab55322 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-unplugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:52:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Instance destroyed successfully.
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lazy-loading 'resources' on Instance uuid 9b7be2de-22e0-4639-ae89-856b4cfb17b4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1963605977',display_name='tempest-TestMinimumBasicScenario-server-1963605977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1963605977',id=25,image_ref='60ef30a0-1876-4fd5-b5e6-0f713900a38d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCI6sgJi6SCLfQjKyUtRCtzVQYpURZ2j5LDAaywthgR5+o0GaA3sllz7unMwlMKTrLcOnUHA7Jev2qQMA2hgyH8ueNx1T3M2tGGw3Y5dpWq/0AnTjCeBEu++cIHIIESng==',key_name='tempest-TestMinimumBasicScenario-1135265511',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:47:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d21cbc9fcc74fdd8579bad00a8ba2eb',ramdisk_id='',reservation_id='r-onzj4n4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='60ef30a0-1876-4fd5-b5e6-0f713900a38d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-554859149',owner_user_name='tempest-TestMinimumBasicScenario-554859149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:49:42Z,user_data=None,user_id='4e5d615d61ea4b1dafa4207d7b21e2d5',uuid=9b7be2de-22e0-4639-ae89-856b4cfb17b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converting VIF {"id": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "address": "fa:16:3e:85:99:55", "network": {"id": "ccc6a426-f548-4d9b-b4d1-89934ac80cf4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-273612439-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d21cbc9fcc74fdd8579bad00a8ba2eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70eb36b4-9f", "ovs_interfaceid": "70eb36b4-9ffc-491e-aed2-56587d2d6d47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG os_vif [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70eb36b4-9f, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:24 user nova-compute[71500]: INFO os_vif [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:99:55,bridge_name='br-int',has_traffic_filtering=True,id=70eb36b4-9ffc-491e-aed2-56587d2d6d47,network=Network(ccc6a426-f548-4d9b-b4d1-89934ac80cf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70eb36b4-9f')
Apr 14 15:52:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Deleting instance files /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4_del
Apr 14 15:52:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Deletion of /opt/stack/data/nova/instances/9b7be2de-22e0-4639-ae89-856b4cfb17b4_del complete
Apr 14 15:52:24 user nova-compute[71500]: INFO nova.compute.manager [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 15:52:24 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:52:24 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Took 0.72 seconds to deallocate network for instance.
Apr 14 15:52:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-a465fe85-eda1-4cfa-bbe3-d167bda0b7fb req-91e2291b-fafa-4a0e-af6e-50b9aa37c4e2 service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-deleted-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:25 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Deleted allocations for instance 9b7be2de-22e0-4639-ae89-856b4cfb17b4
Apr 14 15:52:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7453b5e-d796-4e25-93cb-40748af387c3 tempest-TestMinimumBasicScenario-554859149 tempest-TestMinimumBasicScenario-554859149-project-member] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Acquiring lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] Lock "9b7be2de-22e0-4639-ae89-856b4cfb17b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] No waiting events found dispatching network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:25 user nova-compute[71500]: WARNING nova.compute.manager [req-421c51c5-c7e7-4690-82b6-1abe811f9478 req-119f43c4-5b7f-44fa-8c8c-3301e4a99dea service nova] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Received unexpected event network-vif-plugged-70eb36b4-9ffc-491e-aed2-56587d2d6d47 for instance with vm_state deleted and task_state None.
Apr 14 15:52:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:29 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487534.8935719, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:52:29 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Stopped (Lifecycle Event)
Apr 14 15:52:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f3f20f66-bb77-47ea-b25b-9581dedaeaa1 None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f3f20f66-bb77-47ea-b25b-9581dedaeaa1 None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:52:33 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 15:52:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 15:52:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:52:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:52:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:52:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:52:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [{"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-0f27f459-5b11-4564-ab4c-7194b18319f4" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:52:38 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487544.040418, 9b7be2de-22e0-4639-ae89-856b4cfb17b4 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:52:39 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] VM Stopped (Lifecycle Event)
Apr 14 15:52:39 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bf62978e-a930-451a-adea-e98528b5847f None None] [instance: 9b7be2de-22e0-4639-ae89-856b4cfb17b4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:40 user nova-compute[71500]: INFO nova.compute.manager [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Unrescuing
Apr 14 15:52:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:52:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquired lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:52:40 user nova-compute[71500]: DEBUG nova.network.neutron [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updating instance_info_cache with network_info: [{"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Releasing lock "refresh_cache-0514ed4d-d911-4d2a-b1eb-8373e72894eb" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'flavor' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:41 user nova-compute[71500]: WARNING nova.compute.manager [req-aa2458af-1a85-41e3-a14c-13505e997074 req-f945d240-c21e-4aa5-81e8-038e1c8e4e04 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance destroyed successfully.
Apr 14 15:52:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:52:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:43 user nova-compute[71500]: WARNING nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:43 user nova-compute[71500]: WARNING nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:43 user nova-compute[71500]: WARNING nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:43 user nova-compute[71500]: WARNING nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:43 user nova-compute[71500]: WARNING nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:43 user nova-compute[71500]: WARNING nova.compute.manager [req-8deb526e-54a0-4637-8093-4334f18fe0cd req-d8dac639-a91e-4517-bf60-30994c509ce8 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state rescued and task_state unrescuing.
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 0514ed4d-d911-4d2a-b1eb-8373e72894eb due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487565.223747, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:52:45 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Resumed (Lifecycle Event)
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-03d62940-0e7e-4009-9242-c5a32de9622a tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:52:45 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487565.2248552, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:52:45 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Started (Lifecycle Event)
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:45 user nova-compute[71500]: WARNING nova.compute.manager [req-0cbf2301-23e0-4945-935c-7a651fe33239 req-bf1b0c6d-28b2-48ea-b15a-34f83e1f1de1 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state active and task_state None.
Apr 14 15:52:46 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:50 user nova-compute[71500]: INFO nova.compute.manager [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Terminating instance
Apr 14 15:52:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-unplugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-unplugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG nova.compute.manager [req-e5b1b95e-d911-4fd8-947f-cfadac80a047 req-300fb90c-9280-4495-8a24-fd1f50771363 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-unplugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Instance destroyed successfully.
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'resources' on Instance uuid 40b5c2de-9cb2-4bcc-a04a-a4924e51151c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1486944866',display_name='tempest-ServerRescueNegativeTestJSON-server-1486944866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1486944866',id=6,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:38:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-sdeekh3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:46Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=40b5c2de-9cb2-4bcc-a04a-a4924e51151c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "address": "fa:16:3e:8f:0f:83", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d184083-9a", "ovs_interfaceid": "7d184083-9af2-4aad-abc5-7d9c28804ee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG os_vif [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d184083-9a, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:51 user nova-compute[71500]: INFO os_vif [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:0f:83,bridge_name='br-int',has_traffic_filtering=True,id=7d184083-9af2-4aad-abc5-7d9c28804ee1,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d184083-9a')
Apr 14 15:52:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Deleting instance files /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c_del
Apr 14 15:52:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Deletion of /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c_del complete
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json" returned: 1 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk --force-share --output=json' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:52:51 user nova-compute[71500]: INFO nova.compute.manager [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:52:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/40b5c2de-9cb2-4bcc-a04a-a4924e51151c/disk
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:52:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:52:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:52:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.991016387939453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0f27f459-5b11-4564-ab4c-7194b18319f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 15:52:52 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Took 0.95 seconds to deallocate network for instance.
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-deleted-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:52 user nova-compute[71500]: INFO nova.compute.manager [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Neutron deleted interface 7d184083-9af2-4aad-abc5-7d9c28804ee1; detaching it from the instance and deleting it from the info cache
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-6315134f-b087-4828-8e01-e83fb3bf5d8b req-4e94cd09-7c20-402f-acb3-817fd25d781a service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Detach interface failed, port_id=7d184083-9af2-4aad-abc5-7d9c28804ee1, reason: Instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.154s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Acquiring lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] No waiting events found dispatching network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:52:52 user nova-compute[71500]: WARNING nova.compute.manager [req-0b74aa96-61b4-4208-859e-1ad8ed84248e req-8d65bfc8-b334-4807-8806-891868e00041 service nova] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Received unexpected event network-vif-plugged-7d184083-9af2-4aad-abc5-7d9c28804ee1 for instance with vm_state deleted and task_state None.
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:52:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:52 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Deleted allocations for instance 40b5c2de-9cb2-4bcc-a04a-a4924e51151c
Apr 14 15:52:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-a85899fb-c779-44cd-ae53-478f7338565a tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "40b5c2de-9cb2-4bcc-a04a-a4924e51151c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.708s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:52:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:52:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:06 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487571.240966, 40b5c2de-9cb2-4bcc-a04a-a4924e51151c => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:53:06 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] VM Stopped (Lifecycle Event)
Apr 14 15:53:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-fa0c550d-e6fb-428a-acd7-7d71793110ac None None] [instance: 40b5c2de-9cb2-4bcc-a04a-a4924e51151c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:53:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid d8e21d6b-fc8f-4373-a54f-452ab5fa169c {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid ae5542b8-ac5f-40a6-bbff-8a2734a01583 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:53:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:53:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:53:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:53:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:39 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [{"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:53:40 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:41 user nova-compute[71500]: INFO nova.compute.manager [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Terminating instance
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-400789c4-5fb8-4e1e-806e-f6eeb81fd347 req-233a24b7-6ec3-4022-8c55-3983afa06ab9 service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-unplugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:53:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Instance destroyed successfully.
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lazy-loading 'resources' on Instance uuid 0f27f459-5b11-4564-ab4c-7194b18319f4 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-797939149',display_name='tempest-ServerRescueNegativeTestJSON-server-797939149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-797939149',id=5,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:41:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='609ac7b149e14baab270d83a2646fbdf',ramdisk_id='',reservation_id='r-4lrfed09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1174024196',owner_user_name='tempest-ServerRescueNegativeTestJSON-1174024196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:43:28Z,user_data=None,user_id='3fa924fefda1428d81152fd573540f26',uuid=0f27f459-5b11-4564-ab4c-7194b18319f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converting VIF {"id": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "address": "fa:16:3e:ad:84:39", "network": {"id": "1db86179-bd15-40ef-af2b-5d1b5c8fb4bd", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-963398954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "609ac7b149e14baab270d83a2646fbdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9820d0e-cb", "ovs_interfaceid": "e9820d0e-cb0f-4d8e-b071-3c6c616bf863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG os_vif [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9820d0e-cb, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:41 user nova-compute[71500]: INFO os_vif [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:84:39,bridge_name='br-int',has_traffic_filtering=True,id=e9820d0e-cb0f-4d8e-b071-3c6c616bf863,network=Network(1db86179-bd15-40ef-af2b-5d1b5c8fb4bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9820d0e-cb')
Apr 14 15:53:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Deleting instance files /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4_del
Apr 14 15:53:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Deletion of /opt/stack/data/nova/instances/0f27f459-5b11-4564-ab4c-7194b18319f4_del complete
Apr 14 15:53:41 user nova-compute[71500]: INFO nova.compute.manager [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 15:53:41 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:53:41 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:53:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:42 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:53:42 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Took 0.55 seconds to deallocate network for instance.
Apr 14 15:53:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:42 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:53:42 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:53:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:42 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Deleted allocations for instance 0f27f459-5b11-4564-ab4c-7194b18319f4
Apr 14 15:53:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d7999f5f-7d67-426e-8ebc-5a373da93761 tempest-ServerRescueNegativeTestJSON-1174024196 tempest-ServerRescueNegativeTestJSON-1174024196-project-member] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.854s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Acquiring lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] Lock "0f27f459-5b11-4564-ab4c-7194b18319f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] No waiting events found dispatching network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:53:43 user nova-compute[71500]: WARNING nova.compute.manager [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received unexpected event network-vif-plugged-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 for instance with vm_state deleted and task_state None.
Apr 14 15:53:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-63847c8b-f46d-426c-9bfb-8ce8ebda9279 req-2d9b61aa-c68f-41e2-907e-d757270198de service nova] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Received event network-vif-deleted-e9820d0e-cb0f-4d8e-b071-3c6c616bf863 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:53:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:53:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:53:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8387MB free_disk=26.078269958496094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:53:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:53:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:53:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:53:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:53:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487621.8440514, 0f27f459-5b11-4564-ab4c-7194b18319f4 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:53:56 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] VM Stopped (Lifecycle Event)
Apr 14 15:53:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-a97c7b73-2d13-4f14-b884-525d11aeaaed None None] [instance: 0f27f459-5b11-4564-ab4c-7194b18319f4] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:53:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:53:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquired lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'info_cache' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Releasing lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:54:05 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance destroyed successfully.
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'resources' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG os_vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a9bcd90-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:54:05 user nova-compute[71500]: INFO os_vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba')
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start _get_guest_xml network_info=[{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'numa_topology' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:54:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'pci_devices' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:54:05 user nova-compute[71500]:   <uuid>d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</uuid>
Apr 14 15:54:05 user nova-compute[71500]:   <name>instance-00000017</name>
Apr 14 15:54:05 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:54:05 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:54:05 user nova-compute[71500]:   <metadata>
Apr 14 15:54:05 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:54:05 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:54:05 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeTestJSON-server-997161815</nova:name>
Apr 14 15:54:05 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:54:05</nova:creationTime>
Apr 14 15:54:05 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:54:05 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:54:05 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:54:05 user nova-compute[71500]:       <nova:owner>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:user uuid="b44feacbb8fa4680a965953c122cf31c">tempest-AttachVolumeTestJSON-1357089397-project-member</nova:user>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:project uuid="534f0fb654694b079fa89150594e1bbb">tempest-AttachVolumeTestJSON-1357089397</nova:project>
Apr 14 15:54:05 user nova-compute[71500]:       </nova:owner>
Apr 14 15:54:05 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:54:05 user nova-compute[71500]:       <nova:ports>
Apr 14 15:54:05 user nova-compute[71500]:         <nova:port uuid="9a9bcd90-ba38-4399-9896-69b86979911f">
Apr 14 15:54:05 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 15:54:05 user nova-compute[71500]:         </nova:port>
Apr 14 15:54:05 user nova-compute[71500]:       </nova:ports>
Apr 14 15:54:05 user nova-compute[71500]:     </nova:instance>
Apr 14 15:54:05 user nova-compute[71500]:   </metadata>
Apr 14 15:54:05 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:54:05 user nova-compute[71500]:     <system>
Apr 14 15:54:05 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:54:05 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:54:05 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:54:05 user nova-compute[71500]:       <entry name="serial">d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</entry>
Apr 14 15:54:05 user nova-compute[71500]:       <entry name="uuid">d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297</entry>
Apr 14 15:54:05 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:54:05 user nova-compute[71500]:     </system>
Apr 14 15:54:05 user nova-compute[71500]:   </sysinfo>
Apr 14 15:54:05 user nova-compute[71500]:   <os>
Apr 14 15:54:05 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:54:05 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:54:05 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:54:05 user nova-compute[71500]:   </os>
Apr 14 15:54:05 user nova-compute[71500]:   <features>
Apr 14 15:54:05 user nova-compute[71500]:     <acpi/>
Apr 14 15:54:05 user nova-compute[71500]:     <apic/>
Apr 14 15:54:05 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:54:05 user nova-compute[71500]:   </features>
Apr 14 15:54:05 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:54:05 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:54:05 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:54:05 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:54:05 user nova-compute[71500]:   </clock>
Apr 14 15:54:05 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:54:05 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:54:05 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:54:05 user nova-compute[71500]:   </cpu>
Apr 14 15:54:05 user nova-compute[71500]:   <devices>
Apr 14 15:54:05 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:54:05 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:54:05 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk"/>
Apr 14 15:54:05 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:54:05 user nova-compute[71500]:     </disk>
Apr 14 15:54:05 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:54:05 user nova-compute[71500]:       <mac address="fa:16:3e:9f:d5:01"/>
Apr 14 15:54:05 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:54:05 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:54:05 user nova-compute[71500]:       <target dev="tap9a9bcd90-ba"/>
Apr 14 15:54:05 user nova-compute[71500]:     </interface>
Apr 14 15:54:05 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:54:05 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/console.log" append="off"/>
Apr 14 15:54:05 user nova-compute[71500]:     </serial>
Apr 14 15:54:05 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:54:05 user nova-compute[71500]:     <video>
Apr 14 15:54:05 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:54:05 user nova-compute[71500]:     </video>
Apr 14 15:54:05 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:54:05 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:54:05 user nova-compute[71500]:     </rng>
Apr 14 15:54:05 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:54:05 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:54:05 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:54:05 user nova-compute[71500]:     </memballoon>
Apr 14 15:54:05 user nova-compute[71500]:   </devices>
Apr 14 15:54:05 user nova-compute[71500]: </domain>
Apr 14 15:54:05 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Cannot resize image /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'migration_context' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG os_vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a9bcd90-ba, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a9bcd90-ba, col_values=(('external_ids', {'iface-id': '9a9bcd90-ba38-4399-9896-69b86979911f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:d5:01', 'vm-uuid': 'd4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:54:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:06 user nova-compute[71500]: INFO os_vif [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba')
Apr 14 15:54:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:54:08 user nova-compute[71500]: WARNING nova.compute.manager [req-e1e58454-d141-40c3-bbd7-61255654233f req-98b36ba8-0faf-40fe-b055-7c0dcc78c455 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state stopped and task_state powering-on.
Apr 14 15:54:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487649.8683755, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:54:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Resumed (Lifecycle Event)
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:54:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance rebooted successfully.
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-358b8cae-a7bd-465a-b678-63bd9b4db40d tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:54:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487649.870054, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:54:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Started (Lifecycle Event)
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:54:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:54:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:54:10 user nova-compute[71500]: WARNING nova.compute.manager [req-ba45ba7d-e984-4371-b163-d0eb70eddc2c req-e5fddd3f-8cf5-4e3b-83e0-70db55e2b055 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state active and task_state None.
Apr 14 15:54:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:28 user nova-compute[71500]: INFO nova.compute.manager [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Terminating instance
Apr 14 15:54:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:54:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-4efa165d-1583-4870-a745-1da7e31228e4 req-189f474d-78e6-4937-a176-14a89ee4464c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-unplugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Instance destroyed successfully.
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid fd224b68-1cc6-48cc-bcfe-a1ce40252e65 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:40:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1856157720',display_name='tempest-ServerActionsTestJSON-server-1544279830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1856157720',id=17,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:51:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-xeogu0qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:51:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=fd224b68-1cc6-48cc-bcfe-a1ce40252e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "address": "fa:16:3e:23:f4:2a", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5a1caf6-ba", "ovs_interfaceid": "f5a1caf6-baf3-4c27-82c9-aab287c07447", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_vif [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5a1caf6-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:54:29 user nova-compute[71500]: INFO os_vif [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f4:2a,bridge_name='br-int',has_traffic_filtering=True,id=f5a1caf6-baf3-4c27-82c9-aab287c07447,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5a1caf6-ba')
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'slQVuHUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:54:29 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8524fc49-4e43-4289-bbae-ffe815fd76c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:54:29 user nova-compute[71500]: No targets found.
Apr 14 15:54:29 user nova-compute[71500]: iSNS:
Apr 14 15:54:29 user nova-compute[71500]: No targets found.
Apr 14 15:54:29 user nova-compute[71500]: STATIC:
Apr 14 15:54:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148
Apr 14 15:54:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:54:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:54:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:54:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:54:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:54:29 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:54:29 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:54:29 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:54:29 user nova-compute[71500]: FIRMWARE:
Apr 14 15:54:29 user nova-compute[71500]: No targets found.
Apr 14 15:54:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:54:29 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:54:29 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6167df-556c-4ce6-bd3e-cc14cd4fcb30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a31b7b-9348-4987-9a3d-9a7ded60140f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:54:29 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:54:29 user nova-compute[71500]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:54:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:54:29 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:54:29 user nova-compute[71500]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 (non-flash)
Apr 14 15:54:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadfc137be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e85bed0-3e79-4f5b-ae78-9ba973073c4e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d2ef9-b6c1-435b-9104-30492245f43a]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e71383-a587-4071-8dde-aa894919c726]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a926e-cdcf-4f01-b02e-9154bf4e40b6]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[483bc86f-33fe-4e80-8bd7-6df43f37808e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0844b2d6-7035-4de8-bc86-c4acedf60e67]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260]
Apr 14 15:54:29 user nova-compute[71500]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148, portal: 172.16.0.220,3260] successful.
Apr 14 15:54:29 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66cf9862-011c-4854-822b-3e74a77e5148 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c433d894-6e1f-4c54-8d51-93f81449da22]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (306ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:54:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Deleting instance files /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_del
Apr 14 15:54:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Deletion of /opt/stack/data/nova/instances/fd224b68-1cc6-48cc-bcfe-a1ce40252e65_del complete
Apr 14 15:54:29 user nova-compute[71500]: INFO nova.compute.manager [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 14 15:54:29 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:54:29 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:54:30 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Took 0.85 seconds to deallocate network for instance.
Apr 14 15:54:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-deleted-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:30 user nova-compute[71500]: INFO nova.compute.manager [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Neutron deleted interface f5a1caf6-baf3-4c27-82c9-aab287c07447; detaching it from the instance and deleting it from the info cache
Apr 14 15:54:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-557e8901-a528-43a5-abe6-b9f2c3d46296 req-ea1f9787-7018-4776-9cf5-0b2f253fa577 service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Detach interface failed, port_id=f5a1caf6-baf3-4c27-82c9-aab287c07447, reason: Instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Acquiring lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] No waiting events found dispatching network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:54:30 user nova-compute[71500]: WARNING nova.compute.manager [req-6b0c35b8-e82d-47a1-96c7-bcd94aa5225f req-cc34e246-f0c8-4335-9353-a13f9331b83c service nova] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Received unexpected event network-vif-plugged-f5a1caf6-baf3-4c27-82c9-aab287c07447 for instance with vm_state active and task_state deleting.
Apr 14 15:54:31 user nova-compute[71500]: INFO nova.compute.manager [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:31 user nova-compute[71500]: INFO nova.compute.manager [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Terminating instance
Apr 14 15:54:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:31 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Deleted allocations for instance fd224b68-1cc6-48cc-bcfe-a1ce40252e65
Apr 14 15:54:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-88a0f859-dc47-4bf4-8830-86d01d2f1ed3 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "fd224b68-1cc6-48cc-bcfe-a1ce40252e65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.298s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:32 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Instance destroyed successfully.
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'resources' on Instance uuid 0514ed4d-d911-4d2a-b1eb-8373e72894eb {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2100453200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2100453200',id=26,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-wraqf480',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:52:45Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=0514ed4d-d911-4d2a-b1eb-8373e72894eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "address": "fa:16:3e:8c:f4:b6", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6105a87c-7c", "ovs_interfaceid": "6105a87c-7cb8-4e8e-ab47-ab8b469b918c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_vif [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6105a87c-7c, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:54:32 user nova-compute[71500]: INFO os_vif [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:f4:b6,bridge_name='br-int',has_traffic_filtering=True,id=6105a87c-7cb8-4e8e-ab47-ab8b469b918c,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6105a87c-7c')
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkzKbrSg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:54:32 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e96add-82c3-444e-bcf3-a86bb14d871d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:54:32 user nova-compute[71500]: No targets found.
Apr 14 15:54:32 user nova-compute[71500]: iSNS:
Apr 14 15:54:32 user nova-compute[71500]: No targets found.
Apr 14 15:54:32 user nova-compute[71500]: STATIC:
Apr 14 15:54:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:54:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:54:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:54:32 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811
Apr 14 15:54:32 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:54:32 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:54:32 user nova-compute[71500]: FIRMWARE:
Apr 14 15:54:32 user nova-compute[71500]: No targets found.
Apr 14 15:54:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:54:32 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:54:32 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e931def-0226-43e8-bafa-6ba0c2dc88ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c2081-192c-4180-bbb4-39b7ec800abf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:54:32 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:54:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:54:32 user nova-compute[71500]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 (non-flash)
Apr 14 15:54:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4110ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6559caf9-0f57-4615-8577-beb35a62f1f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb827518-a0e7-4cd0-8406-a20d7cb3d81f]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f7c78-197b-470b-8981-4017af872851]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-unplugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Acquiring lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] No waiting events found dispatching network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:54:32 user nova-compute[71500]: WARNING nova.compute.manager [req-4cf249a0-43d5-4662-923a-c006345762ea req-30555a56-5f98-4178-a9a4-65f312dff2d7 service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received unexpected event network-vif-plugged-6105a87c-7cb8-4e8e-ab47-ab8b469b918c for instance with vm_state active and task_state deleting.
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.075s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ece030-7976-4137-b6d2-beda238d2a7d]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b7487-3737-4284-86d8-ac2c15c37b92]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e43f0be-0a6e-4335-9c4d-e92a0af6c443]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260]
Apr 14 15:54:32 user nova-compute[71500]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811, portal: 172.16.0.220,3260] successful.
Apr 14 15:54:32 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff266ab6-0eba-47a3-aca3-bdf634954811 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6101c3-ee35-4adc-ab41-344ace3e3d6f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== disconnect_volume: return (341ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:54:32 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Deleting instance files /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb_del
Apr 14 15:54:32 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Deletion of /opt/stack/data/nova/instances/0514ed4d-d911-4d2a-b1eb-8373e72894eb_del complete
Apr 14 15:54:32 user nova-compute[71500]: INFO nova.compute.manager [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 15:54:32 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:54:32 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:54:34 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:54:34 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Took 1.31 seconds to deallocate network for instance.
Apr 14 15:54:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-47bf1f1f-a540-4aae-88d8-291def56bd14 req-235fb3fb-3fca-4900-80cb-6bc3c10faabb service nova] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Received event network-vif-deleted-6105a87c-7cb8-4e8e-ab47-ab8b469b918c {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:54:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:34 user nova-compute[71500]: INFO nova.compute.manager [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 15:54:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:35 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:54:35 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:54:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:35 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Deleted allocations for instance 0514ed4d-d911-4d2a-b1eb-8373e72894eb
Apr 14 15:54:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3147a042-a00f-44a5-bd10-db833e862b86 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "0514ed4d-d911-4d2a-b1eb-8373e72894eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.857s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:54:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:54:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:54:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:54:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Updating instance_info_cache with network_info: [{"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-ae5542b8-ac5f-40a6-bbff-8a2734a01583" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:54:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:43 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:54:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:44 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487669.185499, fd224b68-1cc6-48cc-bcfe-a1ce40252e65 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:54:44 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] VM Stopped (Lifecycle Event)
Apr 14 15:54:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8c6c16cb-81b8-4c18-a8e9-233d75fa4166 None None] [instance: fd224b68-1cc6-48cc-bcfe-a1ce40252e65] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:54:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:47 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487672.302637, 0514ed4d-d911-4d2a-b1eb-8373e72894eb => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:54:47 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] VM Stopped (Lifecycle Event)
Apr 14 15:54:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-626c2239-5db3-46df-8d87-70c357e3bad6 None None] [instance: 0514ed4d-d911-4d2a-b1eb-8373e72894eb] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:54:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:54:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:54:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:54:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8417MB free_disk=26.09573745727539GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ae5542b8-ac5f-40a6-bbff-8a2734a01583 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:54:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:54:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:54:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:55:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:55:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:55:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:55:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:55:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:55:20 user nova-compute[71500]: INFO nova.compute.claims [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Claim successful on node user
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:55:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.policy [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:55:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Creating image(s)
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "/opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "/opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.154s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk 1073741824" returned: 0 in 0.084s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.170s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:55:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Cannot resize image /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'migration_context' on Instance uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Ensure instance console log exists: /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Successfully created port: e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:22 user nova-compute[71500]: INFO nova.compute.manager [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Terminating instance
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-unplugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-unplugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a8a5df6-a6f2-489c-b8b8-ef23ddd01cc5 req-7ff3821a-139c-4bdb-8ccf-8de37f0e6d47 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-unplugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Successfully updated port: e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:55:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Instance destroyed successfully.
Apr 14 15:55:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'resources' on Instance uuid ae5542b8-ac5f-40a6-bbff-8a2734a01583 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:55:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1749968002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1749968002',id=22,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-e1qj5ig4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:47:57Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=ae5542b8-ac5f-40a6-bbff-8a2734a01583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "address": "fa:16:3e:cf:e3:00", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd9b8743-1e", "ovs_interfaceid": "cd9b8743-1e76-4694-91d4-4420b8e16ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG os_vif [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd9b8743-1e, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-changed-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Refreshing instance network info cache due to event network-changed-e3e86dec-e3bf-4584-8918-eb5d22e8428a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:55:23 user nova-compute[71500]: INFO os_vif [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e3:00,bridge_name='br-int',has_traffic_filtering=True,id=cd9b8743-1e76-4694-91d4-4420b8e16ce2,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd9b8743-1e')
Apr 14 15:55:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Deleting instance files /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583_del
Apr 14 15:55:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Deletion of /opt/stack/data/nova/instances/ae5542b8-ac5f-40a6-bbff-8a2734a01583_del complete
Apr 14 15:55:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 14 15:55:23 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Instance network_info: |[{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Refreshing network info cache for port e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Start _get_guest_xml network_info=[{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:55:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:55:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-162942861',display_name='tempest-ServerActionsTestJSON-server-162942861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-162942861',id=27,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-occs70iz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=e0fcb3f5-6676-43a8-b6e2-2da51d195110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_devices' on Instance uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:55:23 user nova-compute[71500]:   <uuid>e0fcb3f5-6676-43a8-b6e2-2da51d195110</uuid>
Apr 14 15:55:23 user nova-compute[71500]:   <name>instance-0000001b</name>
Apr 14 15:55:23 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:55:23 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:55:23 user nova-compute[71500]:   <metadata>
Apr 14 15:55:23 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:55:23 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:55:23 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-162942861</nova:name>
Apr 14 15:55:23 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:55:23</nova:creationTime>
Apr 14 15:55:23 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:55:23 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:55:23 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:55:23 user nova-compute[71500]:       <nova:owner>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:55:23 user nova-compute[71500]:       </nova:owner>
Apr 14 15:55:23 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:55:23 user nova-compute[71500]:       <nova:ports>
Apr 14 15:55:23 user nova-compute[71500]:         <nova:port uuid="e3e86dec-e3bf-4584-8918-eb5d22e8428a">
Apr 14 15:55:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 15:55:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:55:23 user nova-compute[71500]:       </nova:ports>
Apr 14 15:55:23 user nova-compute[71500]:     </nova:instance>
Apr 14 15:55:23 user nova-compute[71500]:   </metadata>
Apr 14 15:55:23 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:55:23 user nova-compute[71500]:     <system>
Apr 14 15:55:23 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:55:23 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:55:23 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:55:23 user nova-compute[71500]:       <entry name="serial">e0fcb3f5-6676-43a8-b6e2-2da51d195110</entry>
Apr 14 15:55:23 user nova-compute[71500]:       <entry name="uuid">e0fcb3f5-6676-43a8-b6e2-2da51d195110</entry>
Apr 14 15:55:23 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:55:23 user nova-compute[71500]:     </system>
Apr 14 15:55:23 user nova-compute[71500]:   </sysinfo>
Apr 14 15:55:23 user nova-compute[71500]:   <os>
Apr 14 15:55:23 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:55:23 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:55:23 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:55:23 user nova-compute[71500]:   </os>
Apr 14 15:55:23 user nova-compute[71500]:   <features>
Apr 14 15:55:23 user nova-compute[71500]:     <acpi/>
Apr 14 15:55:23 user nova-compute[71500]:     <apic/>
Apr 14 15:55:23 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:55:23 user nova-compute[71500]:   </features>
Apr 14 15:55:23 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:55:23 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:55:23 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:55:23 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:55:23 user nova-compute[71500]:   </clock>
Apr 14 15:55:23 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:55:23 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:55:23 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:55:23 user nova-compute[71500]:   </cpu>
Apr 14 15:55:23 user nova-compute[71500]:   <devices>
Apr 14 15:55:23 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:55:23 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:55:23 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk"/>
Apr 14 15:55:23 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:55:23 user nova-compute[71500]:     </disk>
Apr 14 15:55:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:55:23 user nova-compute[71500]:       <mac address="fa:16:3e:23:b3:c6"/>
Apr 14 15:55:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:55:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:55:23 user nova-compute[71500]:       <target dev="tape3e86dec-e3"/>
Apr 14 15:55:23 user nova-compute[71500]:     </interface>
Apr 14 15:55:23 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:55:23 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/console.log" append="off"/>
Apr 14 15:55:23 user nova-compute[71500]:     </serial>
Apr 14 15:55:23 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:55:23 user nova-compute[71500]:     <video>
Apr 14 15:55:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:55:23 user nova-compute[71500]:     </video>
Apr 14 15:55:23 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:55:23 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:55:23 user nova-compute[71500]:     </rng>
Apr 14 15:55:23 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:55:23 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:55:23 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:55:23 user nova-compute[71500]:     </memballoon>
Apr 14 15:55:23 user nova-compute[71500]:   </devices>
Apr 14 15:55:23 user nova-compute[71500]: </domain>
Apr 14 15:55:23 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-162942861',display_name='tempest-ServerActionsTestJSON-server-162942861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-162942861',id=27,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-occs70iz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=e0fcb3f5-6676-43a8-b6e2-2da51d195110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG os_vif [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3e86dec-e3, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3e86dec-e3, col_values=(('external_ids', {'iface-id': 'e3e86dec-e3bf-4584-8918-eb5d22e8428a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:b3:c6', 'vm-uuid': 'e0fcb3f5-6676-43a8-b6e2-2da51d195110'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:23 user nova-compute[71500]: INFO os_vif [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3')
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:23:b3:c6, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:55:23 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:24 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Took 0.90 seconds to deallocate network for instance.
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updated VIF entry in instance network info cache for port e3e86dec-e3bf-4584-8918-eb5d22e8428a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-29b7d2a6-b8a7-4548-a7f0-9e944eacfd3f req-489b36cc-8885-45f7-acb8-c9a6906e7446 service nova] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Deleted allocations for instance ae5542b8-ac5f-40a6-bbff-8a2734a01583
Apr 14 15:55:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7a2a1357-8830-449c-bc06-34586e094ffd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:24 user nova-compute[71500]: WARNING nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state deleted and task_state None.
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:24 user nova-compute[71500]: WARNING nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state deleted and task_state None.
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:24 user nova-compute[71500]: WARNING nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state deleted and task_state None.
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-unplugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-unplugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:24 user nova-compute[71500]: WARNING nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-unplugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state deleted and task_state None.
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Acquiring lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] Lock "ae5542b8-ac5f-40a6-bbff-8a2734a01583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] No waiting events found dispatching network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:24 user nova-compute[71500]: WARNING nova.compute.manager [req-7883b134-abeb-4a92-ab29-6610573c8935 req-073f9a56-f1a0-46fe-9cbd-2ae063e8e8c3 service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received unexpected event network-vif-plugged-cd9b8743-1e76-4694-91d4-4420b8e16ce2 for instance with vm_state deleted and task_state None.
Apr 14 15:55:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-389a2cdb-ae5d-4769-bc86-8f11c7cf35e4 req-2c3de141-6d72-4053-b500-89be803e70ef service nova] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Received event network-vif-deleted-cd9b8743-1e76-4694-91d4-4420b8e16ce2 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] No waiting events found dispatching network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:25 user nova-compute[71500]: WARNING nova.compute.manager [req-004f46b6-1b31-43ff-8d6c-e64764405be3 req-393796d4-ee0b-435b-b77d-6e87442559d1 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received unexpected event network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance with vm_state building and task_state spawning.
Apr 14 15:55:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487727.2490642, e0fcb3f5-6676-43a8-b6e2-2da51d195110 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] VM Resumed (Lifecycle Event)
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Instance spawned successfully.
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487727.2502525, e0fcb3f5-6676-43a8-b6e2-2da51d195110 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] VM Started (Lifecycle Event)
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] No waiting events found dispatching network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:27 user nova-compute[71500]: WARNING nova.compute.manager [req-100bc538-1725-44ca-9d23-c3cbda8d4534 req-09b8fbdb-63e9-40d2-8c30-0047ff17e808 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received unexpected event network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance with vm_state building and task_state spawning.
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Took 5.98 seconds to spawn the instance on the hypervisor.
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.manager [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Took 6.64 seconds to build instance.
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ea80a76-83d3-4d69-89ba-44b9e4aea2e4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.742s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.compute.claims [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Claim successful on node user
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:55:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:55:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:55:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Creating image(s)
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "/opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "/opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "/opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.policy [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '324bd0e5d45b424fbf12bcf336f10894', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b71f0ba039b408691746831d3ca9d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.210s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk 1073741824" returned: 0 in 0.051s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Cannot resize image /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lazy-loading 'migration_context' on Instance uuid 885a9f3e-7deb-47e9-84df-8879ee0659a1 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Ensure instance console log exists: /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Successfully created port: 1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:55:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Successfully updated port: 1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "refresh_cache-885a9f3e-7deb-47e9-84df-8879ee0659a1" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquired lock "refresh_cache-885a9f3e-7deb-47e9-84df-8879ee0659a1" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-changed-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Refreshing instance network info cache due to event network-changed-1f437122-97ba-41e8-9d63-5d1686920360. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Acquiring lock "refresh_cache-885a9f3e-7deb-47e9-84df-8879ee0659a1" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Updating instance_info_cache with network_info: [{"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Releasing lock "refresh_cache-885a9f3e-7deb-47e9-84df-8879ee0659a1" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Instance network_info: |[{"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Acquired lock "refresh_cache-885a9f3e-7deb-47e9-84df-8879ee0659a1" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Refreshing network info cache for port 1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Start _get_guest_xml network_info=[{"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:55:30 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:55:30 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1548416193',display_name='tempest-VolumesNegativeTest-instance-1548416193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1548416193',id=28,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71f0ba039b408691746831d3ca9d91',ramdisk_id='',reservation_id='r-2vm50lzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-273784340',owner_user_name='tempest-VolumesNegativeTest-273784340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:55:28Z,user_data=None,user_id='324bd0e5d45b424fbf12bcf336f10894',uuid=885a9f3e-7deb-47e9-84df-8879ee0659a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Converting VIF {"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lazy-loading 'pci_devices' on Instance uuid 885a9f3e-7deb-47e9-84df-8879ee0659a1 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:55:30 user nova-compute[71500]:   <uuid>885a9f3e-7deb-47e9-84df-8879ee0659a1</uuid>
Apr 14 15:55:30 user nova-compute[71500]:   <name>instance-0000001c</name>
Apr 14 15:55:30 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:55:30 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:55:30 user nova-compute[71500]:   <metadata>
Apr 14 15:55:30 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:55:30 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:55:30 user nova-compute[71500]:       <nova:name>tempest-VolumesNegativeTest-instance-1548416193</nova:name>
Apr 14 15:55:30 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:55:30</nova:creationTime>
Apr 14 15:55:30 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:55:30 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:55:30 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:55:30 user nova-compute[71500]:       <nova:owner>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:user uuid="324bd0e5d45b424fbf12bcf336f10894">tempest-VolumesNegativeTest-273784340-project-member</nova:user>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:project uuid="9b71f0ba039b408691746831d3ca9d91">tempest-VolumesNegativeTest-273784340</nova:project>
Apr 14 15:55:30 user nova-compute[71500]:       </nova:owner>
Apr 14 15:55:30 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:55:30 user nova-compute[71500]:       <nova:ports>
Apr 14 15:55:30 user nova-compute[71500]:         <nova:port uuid="1f437122-97ba-41e8-9d63-5d1686920360">
Apr 14 15:55:30 user nova-compute[71500]:           <nova:ip type="fixed" address="192.168.233.181" ipVersion="4"/>
Apr 14 15:55:30 user nova-compute[71500]:         </nova:port>
Apr 14 15:55:30 user nova-compute[71500]:       </nova:ports>
Apr 14 15:55:30 user nova-compute[71500]:     </nova:instance>
Apr 14 15:55:30 user nova-compute[71500]:   </metadata>
Apr 14 15:55:30 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:55:30 user nova-compute[71500]:     <system>
Apr 14 15:55:30 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:55:30 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:55:30 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:55:30 user nova-compute[71500]:       <entry name="serial">885a9f3e-7deb-47e9-84df-8879ee0659a1</entry>
Apr 14 15:55:30 user nova-compute[71500]:       <entry name="uuid">885a9f3e-7deb-47e9-84df-8879ee0659a1</entry>
Apr 14 15:55:30 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:55:30 user nova-compute[71500]:     </system>
Apr 14 15:55:30 user nova-compute[71500]:   </sysinfo>
Apr 14 15:55:30 user nova-compute[71500]:   <os>
Apr 14 15:55:30 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:55:30 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:55:30 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:55:30 user nova-compute[71500]:   </os>
Apr 14 15:55:30 user nova-compute[71500]:   <features>
Apr 14 15:55:30 user nova-compute[71500]:     <acpi/>
Apr 14 15:55:30 user nova-compute[71500]:     <apic/>
Apr 14 15:55:30 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:55:30 user nova-compute[71500]:   </features>
Apr 14 15:55:30 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:55:30 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:55:30 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:55:30 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:55:30 user nova-compute[71500]:   </clock>
Apr 14 15:55:30 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:55:30 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:55:30 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:55:30 user nova-compute[71500]:   </cpu>
Apr 14 15:55:30 user nova-compute[71500]:   <devices>
Apr 14 15:55:30 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:55:30 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:55:30 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk"/>
Apr 14 15:55:30 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:55:30 user nova-compute[71500]:     </disk>
Apr 14 15:55:30 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:55:30 user nova-compute[71500]:       <mac address="fa:16:3e:80:fc:dd"/>
Apr 14 15:55:30 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:55:30 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:55:30 user nova-compute[71500]:       <target dev="tap1f437122-97"/>
Apr 14 15:55:30 user nova-compute[71500]:     </interface>
Apr 14 15:55:30 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:55:30 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/console.log" append="off"/>
Apr 14 15:55:30 user nova-compute[71500]:     </serial>
Apr 14 15:55:30 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:55:30 user nova-compute[71500]:     <video>
Apr 14 15:55:30 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:55:30 user nova-compute[71500]:     </video>
Apr 14 15:55:30 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:55:30 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:55:30 user nova-compute[71500]:     </rng>
Apr 14 15:55:30 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:55:30 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:55:30 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:55:30 user nova-compute[71500]:     </memballoon>
Apr 14 15:55:30 user nova-compute[71500]:   </devices>
Apr 14 15:55:30 user nova-compute[71500]: </domain>
Apr 14 15:55:30 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1548416193',display_name='tempest-VolumesNegativeTest-instance-1548416193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1548416193',id=28,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b71f0ba039b408691746831d3ca9d91',ramdisk_id='',reservation_id='r-2vm50lzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-273784340',owner_user_name='tempest-VolumesNegativeTest-273784340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:55:28Z,user_data=None,user_id='324bd0e5d45b424fbf12bcf336f10894',uuid=885a9f3e-7deb-47e9-84df-8879ee0659a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Converting VIF {"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG os_vif [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f437122-97, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f437122-97, col_values=(('external_ids', {'iface-id': '1f437122-97ba-41e8-9d63-5d1686920360', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:fc:dd', 'vm-uuid': '885a9f3e-7deb-47e9-84df-8879ee0659a1'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:30 user nova-compute[71500]: INFO os_vif [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97')
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:55:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] No VIF found with MAC fa:16:3e:80:fc:dd, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:55:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Updated VIF entry in instance network info cache for port 1f437122-97ba-41e8-9d63-5d1686920360. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:55:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Updating instance_info_cache with network_info: [{"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f522354e-d0a6-48c7-8888-565ffce4f74e req-15741508-10ad-4359-bde2-31d2501b0ebd service nova] Releasing lock "refresh_cache-885a9f3e-7deb-47e9-84df-8879ee0659a1" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] No waiting events found dispatching network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:32 user nova-compute[71500]: WARNING nova.compute.manager [req-61d3ef0c-aa35-460b-bb6f-f01d5f752a7c req-9131c4f9-7e24-430d-8575-a214c384075f service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received unexpected event network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 for instance with vm_state building and task_state spawning.
Apr 14 15:55:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487734.2737272, 885a9f3e-7deb-47e9-84df-8879ee0659a1 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] VM Resumed (Lifecycle Event)
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Instance spawned successfully.
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487734.275066, 885a9f3e-7deb-47e9-84df-8879ee0659a1 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] VM Started (Lifecycle Event)
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:34 user nova-compute[71500]: INFO nova.compute.manager [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Took 6.99 seconds to build instance.
Apr 14 15:55:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-b1e32f10-7e1d-41a6-8e2d-dcfdf9a7b3be tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.079s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] No waiting events found dispatching network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:34 user nova-compute[71500]: WARNING nova.compute.manager [req-a91e0d2b-3cce-498e-81e3-6eb93f806ec9 req-847a2da9-ea70-4063-a741-1732fc0e20ac service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received unexpected event network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 for instance with vm_state active and task_state None.
Apr 14 15:55:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:37 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487722.967171, ae5542b8-ac5f-40a6-bbff-8a2734a01583 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:55:37 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] VM Stopped (Lifecycle Event)
Apr 14 15:55:38 user nova-compute[71500]: DEBUG nova.compute.manager [None req-0b7dcc36-0c86-4f5f-a369-fe345bb8e60d None None] [instance: ae5542b8-ac5f-40a6-bbff-8a2734a01583] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:55:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:42 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:55:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:55:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:55:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:55:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [{"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:55:43 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:55:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:55:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:55:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:55:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8292MB free_disk=26.135990142822266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:55:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:55:53 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:55:53 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:55:53 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:55:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:55:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:56 user nova-compute[71500]: INFO nova.compute.manager [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Terminating instance
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-93cb80b6-6368-4981-9416-242ba756650e req-d232d0ed-129a-45f7-814b-6870ab5a026d service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-unplugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Instance destroyed successfully.
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.objects.instance [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'resources' on Instance uuid d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:46:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-997161815',display_name='tempest-AttachVolumeTestJSON-server-997161815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-997161815',id=23,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvijkP8DXBLhB2Q6gSjDQlgdGG1K/hc5mEyvzpItomHSAx/m7M9p6C6PokLp3qjcl2Vz4ujRoHQ99AsdBXb4Dcvlh8N4ZLw2mXfulDnVOgLSfRu3trzwk0GeMc6FBpuQ==',key_name='tempest-keypair-734921168',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-9i00y3k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "9a9bcd90-ba38-4399-9896-69b86979911f", "address": "fa:16:3e:9f:d5:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a9bcd90-ba", "ovs_interfaceid": "9a9bcd90-ba38-4399-9896-69b86979911f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG os_vif [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a9bcd90-ba, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:55:56 user nova-compute[71500]: INFO os_vif [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:d5:01,bridge_name='br-int',has_traffic_filtering=True,id=9a9bcd90-ba38-4399-9896-69b86979911f,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a9bcd90-ba')
Apr 14 15:55:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Deleting instance files /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297_del
Apr 14 15:55:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Deletion of /opt/stack/data/nova/instances/d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297_del complete
Apr 14 15:55:56 user nova-compute[71500]: INFO nova.compute.manager [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 15:55:56 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:55:56 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:57 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Took 0.90 seconds to deallocate network for instance.
Apr 14 15:55:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-deleted-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:57 user nova-compute[71500]: INFO nova.compute.manager [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Neutron deleted interface 9a9bcd90-ba38-4399-9896-69b86979911f; detaching it from the instance and deleting it from the info cache
Apr 14 15:55:57 user nova-compute[71500]: DEBUG nova.network.neutron [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-44df7fd2-034e-485d-9a9c-91a826eedab1 req-7bb93ec1-9877-4223-ad68-a21a69b5c7a7 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Detach interface failed, port_id=9a9bcd90-ba38-4399-9896-69b86979911f, reason: Instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:55:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:57 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Deleted allocations for instance d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297
Apr 14 15:55:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-441b693d-b488-4b5b-a746-61ac45d7fc58 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:55:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Acquiring lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:55:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:55:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] Lock "d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:55:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] No waiting events found dispatching network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:55:58 user nova-compute[71500]: WARNING nova.compute.manager [req-0c6fac2c-c10a-410f-a354-1746d6e64cca req-3db08963-b470-42c7-b810-e8f240aa2591 service nova] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Received unexpected event network-vif-plugged-9a9bcd90-ba38-4399-9896-69b86979911f for instance with vm_state deleted and task_state None.
Apr 14 15:55:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:11 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487756.6276822, d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:56:11 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] VM Stopped (Lifecycle Event)
Apr 14 15:56:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2257ce49-e94b-4606-9bba-5cb23f12af02 None None] [instance: d4ac5bfb-11c3-4cb9-85b3-5e6f09b3d297] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:56:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:13 user nova-compute[71500]: INFO nova.compute.manager [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Terminating instance
Apr 14 15:56:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-5ee14a7f-210f-4d6e-96a2-2624d0aa3fca req-5d2ad52c-3e07-486d-b99e-bbbb926661b4 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-unplugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Instance destroyed successfully.
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'resources' on Instance uuid e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-323856204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-323856204',id=16,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-3bxuxzha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:44:14Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "18973ac2-c226-4d12-98e7-5bbee348527a", "address": "fa:16:3e:88:f7:a1", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18973ac2-c2", "ovs_interfaceid": "18973ac2-c226-4d12-98e7-5bbee348527a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_vif [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18973ac2-c2, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:14 user nova-compute[71500]: INFO os_vif [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:f7:a1,bridge_name='br-int',has_traffic_filtering=True,id=18973ac2-c226-4d12-98e7-5bbee348527a,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18973ac2-c2')
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bEOCaKTZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:56:14 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f4b56-4352-41be-82d5-81283ac225fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:56:14 user nova-compute[71500]: No targets found.
Apr 14 15:56:14 user nova-compute[71500]: iSNS:
Apr 14 15:56:14 user nova-compute[71500]: No targets found.
Apr 14 15:56:14 user nova-compute[71500]: STATIC:
Apr 14 15:56:14 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4
Apr 14 15:56:14 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:56:14 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:56:14 user nova-compute[71500]: FIRMWARE:
Apr 14 15:56:14 user nova-compute[71500]: No targets found.
Apr 14 15:56:14 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:56:14 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:56:14 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b863e0-de57-4845-b334-cbecb6b913da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca8840e-d42d-4d52-bd69-7d01b457f734]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:56:14 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 (non-flash)
Apr 14 15:56:14 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4112320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6414e1f7-a3e7-4a09-8162-b97f97d5484e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04df61e-7493-4ec4-a432-cc7a16a402ca]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a7f0fd-a686-47eb-909b-d425731bf1d5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adb8d1c-418b-4ae9-a4ef-8a7819036d9e]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4ca66-4e56-41b9-93e6-eb45f64ee1ed]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9aad44-9a13-47b1-ac82-5fa81cf070eb]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260]
Apr 14 15:56:14 user nova-compute[71500]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4, portal: 172.16.0.220,3260] successful.
Apr 14 15:56:14 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34a8d836-37e0-4250-9c77-0bec8d481ee4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d93630-f07f-4fd7-a7e2-f56e7c97beba]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] <== disconnect_volume: return (303ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:56:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Deleting instance files /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3_del
Apr 14 15:56:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Deletion of /opt/stack/data/nova/instances/e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3_del complete
Apr 14 15:56:14 user nova-compute[71500]: INFO nova.compute.manager [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 15:56:14 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:56:14 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:56:15 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:56:15 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Took 0.73 seconds to deallocate network for instance.
Apr 14 15:56:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-ead9a815-f668-47d1-b4a3-49fa01552e38 req-199e13d9-b82e-41d7-b4ee-f4f3f500d3c8 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-deleted-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:56:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:56:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Acquiring lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] No waiting events found dispatching network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:56:15 user nova-compute[71500]: WARNING nova.compute.manager [req-eeadeef8-aea7-4ab9-a599-51c1c0813575 req-fcb1b695-3767-451a-8028-7b1b44f9ddf8 service nova] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Received unexpected event network-vif-plugged-18973ac2-c226-4d12-98e7-5bbee348527a for instance with vm_state active and task_state deleting.
Apr 14 15:56:15 user nova-compute[71500]: INFO nova.compute.manager [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 15:56:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:16 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:56:16 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:56:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:16 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Deleted allocations for instance e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3
Apr 14 15:56:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-da546455-a809-4311-8f4e-ef80afe9a043 tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:28 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487773.9956982, e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:56:28 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] VM Stopped (Lifecycle Event)
Apr 14 15:56:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-321bac53-e957-480b-a19a-cf5228796b4a None None] [instance: e33d2dc2-145c-4bf3-b1cc-b84e935d4bf3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:56:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:56:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:56:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:56:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:56:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:56:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:56:42 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:56:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 15:56:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:56:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:56:50 user nova-compute[71500]: INFO nova.compute.claims [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Claim successful on node user
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:56:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:56:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Creating image(s)
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "/opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "/opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:50 user nova-compute[71500]: DEBUG nova.policy [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b44feacbb8fa4680a965953c122cf31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '534f0fb654694b079fa89150594e1bbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk 1073741824" returned: 0 in 0.053s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Cannot resize image /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'migration_context' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Ensure instance console log exists: /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Successfully created port: 62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Successfully updated port: 62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-changed-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Refreshing instance network info cache due to event network-changed-62212714-898b-4797-8121-7ff0e3a55c98. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Acquiring lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Acquired lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Refreshing network info cache for port 62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:56:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:56:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=26.154403686523438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 885a9f3e-7deb-47e9-84df-8879ee0659a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6dd00b6f-6331-4ecb-9ee3-5933afea50cc req-6fbc90af-7193-4738-b87d-391629b4b4bb service nova] Releasing lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquired lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating instance_info_cache with network_info: [{"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Releasing lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Instance network_info: |[{"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Start _get_guest_xml network_info=[{"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:56:53 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:56:53 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-942625841',display_name='tempest-AttachVolumeTestJSON-server-942625841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-942625841',id=29,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCSIAZnoCiRJt45dD0E5xmyyO5lUzvHwlH61yOiQhj4V0wFze8eBEvT7uq5nZcn2ckoN5yUkVVbk6Kf8R6Y+l/LK1oIj6QOlmGmhgF/DWxteCk+8zo62LyLjQwqW9I5Gg==',key_name='tempest-keypair-421873860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-jxt5e3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=e4adfa25-25dc-44d5-9b0e-414185c6bf7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'pci_devices' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:56:53 user nova-compute[71500]:   <uuid>e4adfa25-25dc-44d5-9b0e-414185c6bf7c</uuid>
Apr 14 15:56:53 user nova-compute[71500]:   <name>instance-0000001d</name>
Apr 14 15:56:53 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:56:53 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:56:53 user nova-compute[71500]:   <metadata>
Apr 14 15:56:53 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:56:53 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:56:53 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeTestJSON-server-942625841</nova:name>
Apr 14 15:56:53 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:56:53</nova:creationTime>
Apr 14 15:56:53 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:56:53 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:56:53 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:56:53 user nova-compute[71500]:       <nova:owner>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:user uuid="b44feacbb8fa4680a965953c122cf31c">tempest-AttachVolumeTestJSON-1357089397-project-member</nova:user>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:project uuid="534f0fb654694b079fa89150594e1bbb">tempest-AttachVolumeTestJSON-1357089397</nova:project>
Apr 14 15:56:53 user nova-compute[71500]:       </nova:owner>
Apr 14 15:56:53 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:56:53 user nova-compute[71500]:       <nova:ports>
Apr 14 15:56:53 user nova-compute[71500]:         <nova:port uuid="62212714-898b-4797-8121-7ff0e3a55c98">
Apr 14 15:56:53 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 15:56:53 user nova-compute[71500]:         </nova:port>
Apr 14 15:56:53 user nova-compute[71500]:       </nova:ports>
Apr 14 15:56:53 user nova-compute[71500]:     </nova:instance>
Apr 14 15:56:53 user nova-compute[71500]:   </metadata>
Apr 14 15:56:53 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:56:53 user nova-compute[71500]:     <system>
Apr 14 15:56:53 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:56:53 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:56:53 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:56:53 user nova-compute[71500]:       <entry name="serial">e4adfa25-25dc-44d5-9b0e-414185c6bf7c</entry>
Apr 14 15:56:53 user nova-compute[71500]:       <entry name="uuid">e4adfa25-25dc-44d5-9b0e-414185c6bf7c</entry>
Apr 14 15:56:53 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:56:53 user nova-compute[71500]:     </system>
Apr 14 15:56:53 user nova-compute[71500]:   </sysinfo>
Apr 14 15:56:53 user nova-compute[71500]:   <os>
Apr 14 15:56:53 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:56:53 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:56:53 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:56:53 user nova-compute[71500]:   </os>
Apr 14 15:56:53 user nova-compute[71500]:   <features>
Apr 14 15:56:53 user nova-compute[71500]:     <acpi/>
Apr 14 15:56:53 user nova-compute[71500]:     <apic/>
Apr 14 15:56:53 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:56:53 user nova-compute[71500]:   </features>
Apr 14 15:56:53 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:56:53 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:56:53 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:56:53 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:56:53 user nova-compute[71500]:   </clock>
Apr 14 15:56:53 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:56:53 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:56:53 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:56:53 user nova-compute[71500]:   </cpu>
Apr 14 15:56:53 user nova-compute[71500]:   <devices>
Apr 14 15:56:53 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:56:53 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:56:53 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk"/>
Apr 14 15:56:53 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:56:53 user nova-compute[71500]:     </disk>
Apr 14 15:56:53 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:56:53 user nova-compute[71500]:       <mac address="fa:16:3e:d1:55:01"/>
Apr 14 15:56:53 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:56:53 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:56:53 user nova-compute[71500]:       <target dev="tap62212714-89"/>
Apr 14 15:56:53 user nova-compute[71500]:     </interface>
Apr 14 15:56:53 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:56:53 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/console.log" append="off"/>
Apr 14 15:56:53 user nova-compute[71500]:     </serial>
Apr 14 15:56:53 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:56:53 user nova-compute[71500]:     <video>
Apr 14 15:56:53 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:56:53 user nova-compute[71500]:     </video>
Apr 14 15:56:53 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:56:53 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:56:53 user nova-compute[71500]:     </rng>
Apr 14 15:56:53 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:56:53 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:56:53 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:56:53 user nova-compute[71500]:     </memballoon>
Apr 14 15:56:53 user nova-compute[71500]:   </devices>
Apr 14 15:56:53 user nova-compute[71500]: </domain>
Apr 14 15:56:53 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-942625841',display_name='tempest-AttachVolumeTestJSON-server-942625841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-942625841',id=29,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCSIAZnoCiRJt45dD0E5xmyyO5lUzvHwlH61yOiQhj4V0wFze8eBEvT7uq5nZcn2ckoN5yUkVVbk6Kf8R6Y+l/LK1oIj6QOlmGmhgF/DWxteCk+8zo62LyLjQwqW9I5Gg==',key_name='tempest-keypair-421873860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-jxt5e3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:56:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=e4adfa25-25dc-44d5-9b0e-414185c6bf7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG os_vif [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62212714-89, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62212714-89, col_values=(('external_ids', {'iface-id': '62212714-898b-4797-8121-7ff0e3a55c98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:55:01', 'vm-uuid': 'e4adfa25-25dc-44d5-9b0e-414185c6bf7c'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:53 user nova-compute[71500]: INFO os_vif [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89')
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No VIF found with MAC fa:16:3e:d1:55:01, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] No waiting events found dispatching network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:56:54 user nova-compute[71500]: WARNING nova.compute.manager [req-1d94a18f-405e-4e67-82f0-3628d2f00999 req-81ccc1f7-2884-47a4-b7b4-389e6466b54f service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received unexpected event network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 for instance with vm_state building and task_state spawning.
Apr 14 15:56:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487816.6109977, e4adfa25-25dc-44d5-9b0e-414185c6bf7c => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] VM Resumed (Lifecycle Event)
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Instance spawned successfully.
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487816.6120558, e4adfa25-25dc-44d5-9b0e-414185c6bf7c => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] VM Started (Lifecycle Event)
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Took 5.80 seconds to spawn the instance on the hypervisor.
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] No waiting events found dispatching network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:56:56 user nova-compute[71500]: WARNING nova.compute.manager [req-a4064fec-1e5b-487b-b7ce-241f74546dff req-9118fd57-d523-4dab-baff-777f049385eb service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received unexpected event network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 for instance with vm_state building and task_state spawning.
Apr 14 15:56:56 user nova-compute[71500]: INFO nova.compute.manager [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Took 6.36 seconds to build instance.
Apr 14 15:56:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-aaabf1c1-9cfc-4068-9efe-8e3677e8aaaf tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.473s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:56:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:56:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:03 user nova-compute[71500]: INFO nova.compute.manager [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Terminating instance
Apr 14 15:57:03 user nova-compute[71500]: DEBUG nova.compute.manager [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:57:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-vif-unplugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] No waiting events found dispatching network-vif-unplugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-1581af2f-93ec-4178-93e6-442ef82644b2 req-02342905-fc08-4016-a790-4ceb7d765924 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-vif-unplugged-e04c622c-58ef-477e-8d37-eb052355492e for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Instance destroyed successfully.
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.objects.instance [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lazy-loading 'resources' on Instance uuid d8e21d6b-fc8f-4373-a54f-452ab5fa169c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1391704245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1391704245',id=3,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584a53650c014f87b9622f2011996200',ramdisk_id='',reservation_id='r-yo4f6s0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-756745587',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:38:34Z,user_data=None,user_id='efb645d110464e7e85d7c955ee9f3466',uuid=d8e21d6b-fc8f-4373-a54f-452ab5fa169c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converting VIF {"id": "e04c622c-58ef-477e-8d37-eb052355492e", "address": "fa:16:3e:94:b5:6d", "network": {"id": "7c17386f-ee51-4b70-936e-ca90f2fb5615", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-291579974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "584a53650c014f87b9622f2011996200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape04c622c-58", "ovs_interfaceid": "e04c622c-58ef-477e-8d37-eb052355492e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG os_vif [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape04c622c-58, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:04 user nova-compute[71500]: INFO os_vif [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:b5:6d,bridge_name='br-int',has_traffic_filtering=True,id=e04c622c-58ef-477e-8d37-eb052355492e,network=Network(7c17386f-ee51-4b70-936e-ca90f2fb5615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape04c622c-58')
Apr 14 15:57:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Deleting instance files /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c_del
Apr 14 15:57:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Deletion of /opt/stack/data/nova/instances/d8e21d6b-fc8f-4373-a54f-452ab5fa169c_del complete
Apr 14 15:57:04 user nova-compute[71500]: INFO nova.compute.manager [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 14 15:57:04 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:57:04 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:57:05 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:57:05 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Took 1.10 seconds to deallocate network for instance.
Apr 14 15:57:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-59716b48-0879-4aba-b3da-ddc05a283991 req-dd4d9570-81b0-46cf-851e-f96473fb5899 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-vif-deleted-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:05 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:57:05 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:57:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:05 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Deleted allocations for instance d8e21d6b-fc8f-4373-a54f-452ab5fa169c
Apr 14 15:57:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-99ff07d6-190f-4bf1-a2b4-93a20f8b02fd tempest-ServerBootFromVolumeStableRescueTest-756745587 tempest-ServerBootFromVolumeStableRescueTest-756745587-project-member] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.124s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received event network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Acquiring lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] Lock "d8e21d6b-fc8f-4373-a54f-452ab5fa169c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] No waiting events found dispatching network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:57:06 user nova-compute[71500]: WARNING nova.compute.manager [req-9382fd30-a51b-4bec-865e-74ccd0f128dc req-66546d63-7855-4efa-8375-bfef0bc3a772 service nova] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Received unexpected event network-vif-plugged-e04c622c-58ef-477e-8d37-eb052355492e for instance with vm_state deleted and task_state None.
Apr 14 15:57:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-changed-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Refreshing instance network info cache due to event network-changed-e3e86dec-e3bf-4584-8918-eb5d22e8428a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:57:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:57:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:57:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Refreshing network info cache for port e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:57:12 user nova-compute[71500]: DEBUG nova.network.neutron [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updated VIF entry in instance network info cache for port e3e86dec-e3bf-4584-8918-eb5d22e8428a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:57:12 user nova-compute[71500]: DEBUG nova.network.neutron [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:57:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-18befe4c-45ba-40fb-8e03-9e193dbe2ca7 req-c3bd1050-88d3-45f3-80dc-577e70735e47 service nova] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:57:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:57:16 user nova-compute[71500]: INFO nova.compute.claims [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Claim successful on node user
Apr 14 15:57:16 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:57:16 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:57:17 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:57:17 user nova-compute[71500]: INFO nova.virt.block_device [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Booting with volume 6e0de370-c626-4a9d-a636-fbb7cfdb81a8 at /dev/vda
Apr 14 15:57:17 user nova-compute[71500]: DEBUG os_brick.utils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.policy [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3062186c340a4cfe875d5455b0ace246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e26fa4727e46479d108fe49e225706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d448fdb1-5579-4cf7-b0c0-e93e563a1616]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6370993-5ab7-45ee-911f-2dff7725921f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cd089b-8e2d-4719-872d-adde45e25110]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dc170a-577c-4d0e-a0ab-e40f2d473e35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:57:17 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b5b6bd-dec2-45ac-a949-035a3eea030e]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG os_brick.utils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating existing volume attachment record: 023fe966-706f-49a1-add3-2065f688110a {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:17 user nova-compute[71500]: INFO nova.compute.manager [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Terminating instance
Apr 14 15:57:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-vif-unplugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] No waiting events found dispatching network-vif-unplugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-0cd2de77-5334-41d2-8922-3119bc5cf6e2 req-3a0510e5-8e15-4a64-8810-a9c88fa90c8b service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-vif-unplugged-1f437122-97ba-41e8-9d63-5d1686920360 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:57:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Instance destroyed successfully.
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lazy-loading 'resources' on Instance uuid 885a9f3e-7deb-47e9-84df-8879ee0659a1 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1548416193',display_name='tempest-VolumesNegativeTest-instance-1548416193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1548416193',id=28,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b71f0ba039b408691746831d3ca9d91',ramdisk_id='',reservation_id='r-2vm50lzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-273784340',owner_user_name='tempest-VolumesNegativeTest-273784340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:55:34Z,user_data=None,user_id='324bd0e5d45b424fbf12bcf336f10894',uuid=885a9f3e-7deb-47e9-84df-8879ee0659a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Converting VIF {"id": "1f437122-97ba-41e8-9d63-5d1686920360", "address": "fa:16:3e:80:fc:dd", "network": {"id": "41de24e7-cbe6-45b6-baec-fea83e8308a9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.181", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "50e41ae46e6146588368020524d2d409", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f437122-97", "ovs_interfaceid": "1f437122-97ba-41e8-9d63-5d1686920360", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG os_vif [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Successfully created port: bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f437122-97, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:57:18 user nova-compute[71500]: INFO os_vif [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:fc:dd,bridge_name='br-int',has_traffic_filtering=True,id=1f437122-97ba-41e8-9d63-5d1686920360,network=Network(41de24e7-cbe6-45b6-baec-fea83e8308a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f437122-97')
Apr 14 15:57:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Deleting instance files /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1_del
Apr 14 15:57:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Deletion of /opt/stack/data/nova/instances/885a9f3e-7deb-47e9-84df-8879ee0659a1_del complete
Apr 14 15:57:18 user nova-compute[71500]: INFO nova.compute.manager [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 14 15:57:18 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:57:18 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Successfully updated port: bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:57:19 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Took 1.09 seconds to deallocate network for instance.
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-bd8c02a4-62d7-4054-91bd-dc40893235c8 req-3cc83b66-d8bd-49d6-a6c5-d1ab4c6e9cde service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-vif-deleted-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487824.4811232, d8e21d6b-fc8f-4373-a54f-452ab5fa169c => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:57:19 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] VM Stopped (Lifecycle Event)
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-efd02a89-c119-478b-ac63-f1ff2bd5693a None None] [instance: d8e21d6b-fc8f-4373-a54f-452ab5fa169c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:57:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance network_info: |[{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:57:19 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Deleted allocations for instance 885a9f3e-7deb-47e9-84df-8879ee0659a1
Apr 14 15:57:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f93dddfb-7701-410a-999f-fcacb00b0568 tempest-VolumesNegativeTest-273784340 tempest-VolumesNegativeTest-273784340-project-member] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received event network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Acquiring lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] Lock "885a9f3e-7deb-47e9-84df-8879ee0659a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] No waiting events found dispatching network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:57:20 user nova-compute[71500]: WARNING nova.compute.manager [req-da7cafe2-f572-416d-8eea-830cb5f011d4 req-4b983253-b352-4ea5-a3f8-d15e81e8c02a service nova] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Received unexpected event network-vif-plugged-1f437122-97ba-41e8-9d63-5d1686920360 for instance with vm_state deleted and task_state None.
Apr 14 15:57:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-changed-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Refreshing instance network info cache due to event network-changed-bdc45130-027f-49b1-b33a-2a4adbc70f63. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG nova.network.neutron [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Refreshing network info cache for port bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG nova.network.neutron [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updated VIF entry in instance network info cache for port bdc45130-027f-49b1-b33a-2a4adbc70f63. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG nova.network.neutron [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:57:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-11111004-1ae8-483b-98f1-1bcca7193256 req-305f5121-b913-4d51-b1f3-32f2de48fbae service nova] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:57:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Creating image(s)
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Ensure instance console log exists: /opt/stack/data/nova/instances/61119681-6ec1-4dee-bf91-908f479488d5/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Start _get_guest_xml network_info=[{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '023fe966-706f-49a1-add3-2065f688110a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '61119681-6ec1-4dee-bf91-908f479488d5', 'attached_at': '', 'detached_at': '', 'volume_id': '6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'serial': '6e0de370-c626-4a9d-a636-fbb7cfdb81a8'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:57:22 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:57:22 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:57:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:57:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:57:22 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32c03d-7eda-4365-9040-30ce26d495dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:57:22 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[805b1af6-3769-4ea8-b36e-67ae505861bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8] added
Apr 14 15:57:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1ad1a-efae-4a07-9db7-318d3740a19a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f72f71-fe91-4707-b5ae-6fc9b698f676]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytjuFNWr {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytjuFNWr" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8569bab-ef41-435e-91b3-40137b04c8b8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytjuFNWr'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[444940a2-fdbb-4c7e-9c6d-9e6ed1f86a64]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b1485-d4d3-4da1-9fd5-35496ee64f83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:57:22 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:57:22 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:57:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 15:57:22 user nova-compute[71500]: 
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed1f1c-bdec-4afa-b2d1-84624c3b9ac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]
Apr 14 15:57:22 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.
Apr 14 15:57:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef6825b-a975-4985-bf09-3cfdbc58e3eb]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee15308-b35f-48c5-abc5-95f9cc9288e6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:57:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:57:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d8baed-1ca7-41f4-8de7-de4857091be8]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:57:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23665636130643339', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665636130643339', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-866404495',display_name='tempest-ServerActionsTestJSON-server-866404495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-866404495',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-4vsczczp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=61119681-6ec1-4dee-bf91-908f479488d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_devices' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:57:23 user nova-compute[71500]:   <uuid>61119681-6ec1-4dee-bf91-908f479488d5</uuid>
Apr 14 15:57:23 user nova-compute[71500]:   <name>instance-0000001e</name>
Apr 14 15:57:23 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:57:23 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:57:23 user nova-compute[71500]:   <metadata>
Apr 14 15:57:23 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:57:23 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:57:23 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-866404495</nova:name>
Apr 14 15:57:23 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:57:22</nova:creationTime>
Apr 14 15:57:23 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:57:23 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:57:23 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:57:23 user nova-compute[71500]:       <nova:owner>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:57:23 user nova-compute[71500]:       </nova:owner>
Apr 14 15:57:23 user nova-compute[71500]:       <nova:ports>
Apr 14 15:57:23 user nova-compute[71500]:         <nova:port uuid="bdc45130-027f-49b1-b33a-2a4adbc70f63">
Apr 14 15:57:23 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 15:57:23 user nova-compute[71500]:         </nova:port>
Apr 14 15:57:23 user nova-compute[71500]:       </nova:ports>
Apr 14 15:57:23 user nova-compute[71500]:     </nova:instance>
Apr 14 15:57:23 user nova-compute[71500]:   </metadata>
Apr 14 15:57:23 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:57:23 user nova-compute[71500]:     <system>
Apr 14 15:57:23 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:57:23 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:57:23 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:57:23 user nova-compute[71500]:       <entry name="serial">61119681-6ec1-4dee-bf91-908f479488d5</entry>
Apr 14 15:57:23 user nova-compute[71500]:       <entry name="uuid">61119681-6ec1-4dee-bf91-908f479488d5</entry>
Apr 14 15:57:23 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:57:23 user nova-compute[71500]:     </system>
Apr 14 15:57:23 user nova-compute[71500]:   </sysinfo>
Apr 14 15:57:23 user nova-compute[71500]:   <os>
Apr 14 15:57:23 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:57:23 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:57:23 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:57:23 user nova-compute[71500]:   </os>
Apr 14 15:57:23 user nova-compute[71500]:   <features>
Apr 14 15:57:23 user nova-compute[71500]:     <acpi/>
Apr 14 15:57:23 user nova-compute[71500]:     <apic/>
Apr 14 15:57:23 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:57:23 user nova-compute[71500]:   </features>
Apr 14 15:57:23 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:57:23 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:57:23 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:57:23 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:57:23 user nova-compute[71500]:   </clock>
Apr 14 15:57:23 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:57:23 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:57:23 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:57:23 user nova-compute[71500]:   </cpu>
Apr 14 15:57:23 user nova-compute[71500]:   <devices>
Apr 14 15:57:23 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:57:23 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:57:23 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 15:57:23 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:57:23 user nova-compute[71500]:       <serial>6e0de370-c626-4a9d-a636-fbb7cfdb81a8</serial>
Apr 14 15:57:23 user nova-compute[71500]:     </disk>
Apr 14 15:57:23 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:57:23 user nova-compute[71500]:       <mac address="fa:16:3e:5e:c7:2e"/>
Apr 14 15:57:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:57:23 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:57:23 user nova-compute[71500]:       <target dev="tapbdc45130-02"/>
Apr 14 15:57:23 user nova-compute[71500]:     </interface>
Apr 14 15:57:23 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:57:23 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/61119681-6ec1-4dee-bf91-908f479488d5/console.log" append="off"/>
Apr 14 15:57:23 user nova-compute[71500]:     </serial>
Apr 14 15:57:23 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:57:23 user nova-compute[71500]:     <video>
Apr 14 15:57:23 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:57:23 user nova-compute[71500]:     </video>
Apr 14 15:57:23 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:57:23 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:57:23 user nova-compute[71500]:     </rng>
Apr 14 15:57:23 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:57:23 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:57:23 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:57:23 user nova-compute[71500]:     </memballoon>
Apr 14 15:57:23 user nova-compute[71500]:   </devices>
Apr 14 15:57:23 user nova-compute[71500]: </domain>
Apr 14 15:57:23 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-866404495',display_name='tempest-ServerActionsTestJSON-server-866404495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-866404495',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-4vsczczp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=61119681-6ec1-4dee-bf91-908f479488d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG os_vif [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdc45130-02, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdc45130-02, col_values=(('external_ids', {'iface-id': 'bdc45130-027f-49b1-b33a-2a4adbc70f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:c7:2e', 'vm-uuid': '61119681-6ec1-4dee-bf91-908f479488d5'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:23 user nova-compute[71500]: INFO os_vif [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02')
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:57:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:5e:c7:2e, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:57:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:57:25 user nova-compute[71500]: WARNING nova.compute.manager [req-42d65172-1450-41e1-89d3-8fb4a4b9591e req-c6386d46-d196-48f5-b07f-e54ffa714f15 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state building and task_state spawning.
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487847.0184796, 61119681-6ec1-4dee-bf91-908f479488d5 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] VM Resumed (Lifecycle Event)
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance spawned successfully.
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487847.0229394, 61119681-6ec1-4dee-bf91-908f479488d5 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] VM Started (Lifecycle Event)
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:57:27 user nova-compute[71500]: WARNING nova.compute.manager [req-33498a5d-1a6e-49df-9c7c-087748dba2ea req-e8cc8b78-759c-4832-807f-6cd66c66a261 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state building and task_state spawning.
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Took 5.06 seconds to spawn the instance on the hypervisor.
Apr 14 15:57:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:57:27 user nova-compute[71500]: INFO nova.compute.manager [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Took 10.48 seconds to build instance.
Apr 14 15:57:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-44d29a68-81a8-4c07-ab79-a622e651228c tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.692s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:33 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487838.177205, 885a9f3e-7deb-47e9-84df-8879ee0659a1 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:57:33 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] VM Stopped (Lifecycle Event)
Apr 14 15:57:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ebc5a653-e4e3-4c5b-ab58-f95450bea9dd None None] [instance: 885a9f3e-7deb-47e9-84df-8879ee0659a1] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:57:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:57:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 15:57:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:57:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:57:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:57:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:57:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=26.242919921875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 61119681-6ec1-4dee-bf91-908f479488d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:57:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:57:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:55 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:57:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:57:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:58:08 user nova-compute[71500]: INFO nova.compute.claims [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Claim successful on node user
Apr 14 15:58:08 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:58:08 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 15:58:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.policy [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 15:58:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Creating image(s)
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk 1073741824" returned: 0 in 0.051s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Successfully created port: e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Cannot resize image /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'migration_context' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Ensure instance console log exists: /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Successfully updated port: e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing instance network info cache due to event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance network_info: |[{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Start _get_guest_xml network_info=[{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:58:10 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:58:10 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1710480109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1710480109',id=31,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBozYjZa3+L7ZaapG78zt//JX1aKtL9gK6w652fgXQCyNWMbZeFs3dLlpUJFQtL9sOYgL2wsRJ8VKTRuUg35WOo6Bi2bKvhvhXZzKawwCATnuTHiTMAKe03Rf2j5CZzitQ==',key_name='tempest-keypair-506635828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-xsdhc898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:58:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=8ebde9c7-b620-4553-856c-c6a3429381b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:58:10 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.objects.instance [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:58:11 user nova-compute[71500]:   <uuid>8ebde9c7-b620-4553-856c-c6a3429381b6</uuid>
Apr 14 15:58:11 user nova-compute[71500]:   <name>instance-0000001f</name>
Apr 14 15:58:11 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 15:58:11 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:58:11 user nova-compute[71500]:   <metadata>
Apr 14 15:58:11 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:58:11 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:58:11 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1710480109</nova:name>
Apr 14 15:58:11 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:58:10</nova:creationTime>
Apr 14 15:58:11 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 15:58:11 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:58:11 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:58:11 user nova-compute[71500]:       <nova:owner>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:user uuid="194adad706f94ef89a86fbcb9d8888ac">tempest-AttachVolumeShelveTestJSON-1653640190-project-member</nova:user>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:project uuid="b0dd8e5513a94cc8b22c291bac3b066f">tempest-AttachVolumeShelveTestJSON-1653640190</nova:project>
Apr 14 15:58:11 user nova-compute[71500]:       </nova:owner>
Apr 14 15:58:11 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 15:58:11 user nova-compute[71500]:       <nova:ports>
Apr 14 15:58:11 user nova-compute[71500]:         <nova:port uuid="e7e2966b-fc86-47d5-a656-93ba5e362a42">
Apr 14 15:58:11 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 15:58:11 user nova-compute[71500]:         </nova:port>
Apr 14 15:58:11 user nova-compute[71500]:       </nova:ports>
Apr 14 15:58:11 user nova-compute[71500]:     </nova:instance>
Apr 14 15:58:11 user nova-compute[71500]:   </metadata>
Apr 14 15:58:11 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:58:11 user nova-compute[71500]:     <system>
Apr 14 15:58:11 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:58:11 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:58:11 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:58:11 user nova-compute[71500]:       <entry name="serial">8ebde9c7-b620-4553-856c-c6a3429381b6</entry>
Apr 14 15:58:11 user nova-compute[71500]:       <entry name="uuid">8ebde9c7-b620-4553-856c-c6a3429381b6</entry>
Apr 14 15:58:11 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:58:11 user nova-compute[71500]:     </system>
Apr 14 15:58:11 user nova-compute[71500]:   </sysinfo>
Apr 14 15:58:11 user nova-compute[71500]:   <os>
Apr 14 15:58:11 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:58:11 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:58:11 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:58:11 user nova-compute[71500]:   </os>
Apr 14 15:58:11 user nova-compute[71500]:   <features>
Apr 14 15:58:11 user nova-compute[71500]:     <acpi/>
Apr 14 15:58:11 user nova-compute[71500]:     <apic/>
Apr 14 15:58:11 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:58:11 user nova-compute[71500]:   </features>
Apr 14 15:58:11 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:58:11 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:58:11 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:58:11 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:58:11 user nova-compute[71500]:   </clock>
Apr 14 15:58:11 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:58:11 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:58:11 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:58:11 user nova-compute[71500]:   </cpu>
Apr 14 15:58:11 user nova-compute[71500]:   <devices>
Apr 14 15:58:11 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 15:58:11 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 15:58:11 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk"/>
Apr 14 15:58:11 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:58:11 user nova-compute[71500]:     </disk>
Apr 14 15:58:11 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:58:11 user nova-compute[71500]:       <mac address="fa:16:3e:e6:ec:cb"/>
Apr 14 15:58:11 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:58:11 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:58:11 user nova-compute[71500]:       <target dev="tape7e2966b-fc"/>
Apr 14 15:58:11 user nova-compute[71500]:     </interface>
Apr 14 15:58:11 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:58:11 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/console.log" append="off"/>
Apr 14 15:58:11 user nova-compute[71500]:     </serial>
Apr 14 15:58:11 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:58:11 user nova-compute[71500]:     <video>
Apr 14 15:58:11 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:58:11 user nova-compute[71500]:     </video>
Apr 14 15:58:11 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:58:11 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:58:11 user nova-compute[71500]:     </rng>
Apr 14 15:58:11 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:58:11 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:58:11 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:58:11 user nova-compute[71500]:     </memballoon>
Apr 14 15:58:11 user nova-compute[71500]:   </devices>
Apr 14 15:58:11 user nova-compute[71500]: </domain>
Apr 14 15:58:11 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1710480109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1710480109',id=31,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBozYjZa3+L7ZaapG78zt//JX1aKtL9gK6w652fgXQCyNWMbZeFs3dLlpUJFQtL9sOYgL2wsRJ8VKTRuUg35WOo6Bi2bKvhvhXZzKawwCATnuTHiTMAKe03Rf2j5CZzitQ==',key_name='tempest-keypair-506635828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-xsdhc898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T15:58:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=8ebde9c7-b620-4553-856c-c6a3429381b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG os_vif [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7e2966b-fc, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7e2966b-fc, col_values=(('external_ids', {'iface-id': 'e7e2966b-fc86-47d5-a656-93ba5e362a42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ec:cb', 'vm-uuid': '8ebde9c7-b620-4553-856c-c6a3429381b6'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:11 user nova-compute[71500]: INFO os_vif [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc')
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No VIF found with MAC fa:16:3e:e6:ec:cb, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updated VIF entry in instance network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG nova.network.neutron [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:58:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-be94da31-c7b1-450a-b3a8-810f0224f74a req-fd173707-309a-47a0-ae36-88166a0d88c7 service nova] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:58:12 user nova-compute[71500]: WARNING nova.compute.manager [req-da18cb98-2cb2-4705-bc17-368a2c9c2db1 req-5f796f98-814c-45c7-869c-7c71334fc474 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state building and task_state spawning.
Apr 14 15:58:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:58:14 user nova-compute[71500]: WARNING nova.compute.manager [req-496d4054-165b-4925-a420-967bfb80fbc3 req-f752f6b2-fd25-4557-b3c8-ec57e5d33664 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state building and task_state spawning.
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487894.6626391, 8ebde9c7-b620-4553-856c-c6a3429381b6 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] VM Resumed (Lifecycle Event)
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance spawned successfully.
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487894.6639595, 8ebde9c7-b620-4553-856c-c6a3429381b6 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] VM Started (Lifecycle Event)
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 14 15:58:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:58:14 user nova-compute[71500]: INFO nova.compute.manager [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Took 6.13 seconds to build instance.
Apr 14 15:58:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92ca134e-90fe-44d6-bd00-54b56e52dde2 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.228s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:58:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 15:58:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:58:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 15:58:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-changed-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Refreshing instance network info cache due to event network-changed-62212714-898b-4797-8121-7ff0e3a55c98. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Acquiring lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Acquired lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG nova.network.neutron [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Refreshing network info cache for port 62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG nova.network.neutron [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updated VIF entry in instance network info cache for port 62212714-898b-4797-8121-7ff0e3a55c98. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG nova.network.neutron [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating instance_info_cache with network_info: [{"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:58:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fb8bde0b-6bb7-4f1b-858a-2eb300ca74f2 req-6115c9c7-525d-4acf-bf69-f43cf8b5be3d service nova] Releasing lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:58:43 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG nova.objects.instance [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:44 user nova-compute[71500]: INFO nova.compute.manager [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attaching volume 2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 to /dev/vdb
Apr 14 15:58:44 user nova-compute[71500]: DEBUG os_brick.utils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df51746-e78c-4c86-ab29-4edd14ab87c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02d68c3-6caa-4112-9bf0-d143daa90ef7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05ad2b-07ba-412c-988d-f818edb9ea25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f92d6c-26f6-4af5-bccc-08a2aad5701f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:58:44 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:58:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ff2bf1-20b5-4fd5-a306-12bdfd3e9a90]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG os_brick.utils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:58:44 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating existing volume attachment record: 3f7abaa9-30a6-4aac-8c0f-4f47511ad3a5 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:58:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating instance_info_cache with network_info: [{"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-e4adfa25-25dc-44d5-9b0e-414185c6bf7c" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:48 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZmitDVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:58:49 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:58:49 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:58:49 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f355bb-c553-44be-a92b-afad2ce17e14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:58:49 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[acddfd15-8b39-4ade-ad6e-4c6da2aa6440]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13] added
Apr 14 15:58:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d811b-90b8-4b90-a412-f7174cd2351c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf18ddc-5634-4f34-a680-80c8471e90ce]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZmitDVH {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QZmitDVH" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b70ee4e-0afe-4562-adfe-a30c4104aba4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QZmitDVH'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f28201-b97c-419b-8a05-bbe32f486bf9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25ad04-ef71-42f6-b9c8-1998e7dbee10]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace2cc8-935b-4625-8466-e5df1271e5ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260]
Apr 14 15:58:49 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260] successful.
Apr 14 15:58:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1fbd1f-b5f4-4e27-a43f-c372442231a2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb4521-0661-46a2-8741-606d98fe934c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:49 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:58:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:49 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:58:49 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5428f43-40a8-41d9-b496-adbac9053cc0]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZmitDVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23764383163383535', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764383163383535', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG nova.objects.instance [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:58:50 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:58:50 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 15:58:50 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:58:50 user nova-compute[71500]:   <serial>2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13</serial>
Apr 14 15:58:50 user nova-compute[71500]: </disk>
Apr 14 15:58:50 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No VIF found with MAC fa:16:3e:d1:55:01, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:58:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-be2a9992-df94-47ca-8b54-57312bbf4cd3 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.587s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:58:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=26.204097747802734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 61119681-6ec1-4dee-bf91-908f479488d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.objects.instance [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:58:54 user nova-compute[71500]: INFO nova.compute.manager [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attaching volume 60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 to /dev/vdc
Apr 14 15:58:54 user nova-compute[71500]: DEBUG os_brick.utils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[470587c8-a861-4653-bfda-6b357f4b8a2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c5423-4a79-4c90-a066-78614844feb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdb030d-c02d-40e8-93d6-b72be8617177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a011d6d-8128-4a24-82ad-74eaf71a4c4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:58:54 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:58:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e17bc4f-f6cc-4a0a-a28a-624d877bfacf]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG os_brick.utils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:58:54 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating existing volume attachment record: 0fa2abdc-5315-4469-a8a3-fd4fb6c2f65d {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 15:58:55 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:58:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzErPFAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:58:59 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:58:59 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:58:59 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c784cac5-56ec-439a-8618-f40508ad8708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:58:59 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f41350-4b27-4618-9f6d-8daf6348c9b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7] added
Apr 14 15:58:59 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[51903145-f032-43c5-a4c0-cc768e254299]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ec3e5-7fe1-4e11-83c7-d007deaea43a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzErPFAK {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzErPFAK" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9513a07-e8d2-4bf1-8061-8806fdb19ba9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzErPFAK'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7e11d7-4968-4379-967e-fc55d99dd31b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f711058-4427-48bb-9a57-ab9dc4155d5e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4611f4-bfe2-4847-a3d3-e8d24061c25b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260]
Apr 14 15:58:59 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260] successful.
Apr 14 15:58:59 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[720211fd-b35f-4c07-b7f8-54c0da2de9ce]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b209e403-7d71-43ff-84c2-0470ceb77335]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)
Apr 14 15:58:59 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[34027cc8-b7b4-4223-aae3-3001c5f95555]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:58:59 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzErPFAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:59:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:59:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23363393134633438', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:59:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363393134633438', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:59:00 user nova-compute[71500]: DEBUG nova.objects.instance [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 15:59:00 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:59:00 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:59:00 user nova-compute[71500]:   <target dev="vdc" bus="virtio"/>
Apr 14 15:59:00 user nova-compute[71500]:   <serial>60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7</serial>
Apr 14 15:59:00 user nova-compute[71500]: </disk>
Apr 14 15:59:00 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 15:59:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:59:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:59:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:59:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] No VIF found with MAC fa:16:3e:d1:55:01, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:59:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-03c527e1-37bf-4735-bfc9-a079a49b787e tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.479s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:02 user nova-compute[71500]: INFO nova.compute.manager [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Detaching volume 2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13
Apr 14 15:59:03 user nova-compute[71500]: INFO nova.virt.block_device [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attempting to driver detach volume 2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 from mountpoint /dev/vdb
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Attempting to detach device vdb from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:59:03 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:59:03 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 15:59:03 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:59:03 user nova-compute[71500]:   <serial>2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13</serial>
Apr 14 15:59:03 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:59:03 user nova-compute[71500]: </disk>
Apr 14 15:59:03 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:59:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully detached device vdb from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the persistent domain config.
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:59:03 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:59:03 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 15:59:03 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 15:59:03 user nova-compute[71500]:   <serial>2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13</serial>
Apr 14 15:59:03 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 15:59:03 user nova-compute[71500]: </disk>
Apr 14 15:59:03 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487943.4373026, e4adfa25-25dc-44d5-9b0e-414185c6bf7c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:59:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully detached device vdb from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the live domain config.
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QZmitDVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:59:03 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b561d-4287-48fe-a3af-52c0efa51d5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:59:03 user nova-compute[71500]: No targets found.
Apr 14 15:59:03 user nova-compute[71500]: iSNS:
Apr 14 15:59:03 user nova-compute[71500]: No targets found.
Apr 14 15:59:03 user nova-compute[71500]: STATIC:
Apr 14 15:59:03 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8
Apr 14 15:59:03 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:59:03 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:59:03 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13
Apr 14 15:59:03 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:59:03 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:59:03 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7
Apr 14 15:59:03 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:59:03 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:59:03 user nova-compute[71500]: FIRMWARE:
Apr 14 15:59:03 user nova-compute[71500]: No targets found.
Apr 14 15:59:03 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:59:03 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:59:03 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[25edb4e6-8d83-4634-b130-833c8ff920a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f467d-db5a-45da-8bf4-df7afd808884]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:03 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:59:03 user nova-compute[71500]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)
Apr 14 15:59:03 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:03 user nova-compute[71500]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 (non-flash)
Apr 14 15:59:03 user nova-compute[71500]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)
Apr 14 15:59:03 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc6f2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eda42b-aa85-4e0c-aeb9-1cb1590b0b7a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8114d0-ea91-4fb5-bd87-daaa3adb9b0e]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e6f87-cc12-4916-bc44-bbd0e09dff58]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.153s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dd3900-e4c7-4beb-9ea0-c292227d63b3]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf55dcc-c992-499e-93b7-d19a70dfa29f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ee7f3-7a2b-40ca-81c1-1f9c78c7a8f6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260]
Apr 14 15:59:03 user nova-compute[71500]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13, portal: 172.16.0.220,3260] successful.
Apr 14 15:59:03 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c9c6ac7-921d-4bba-b7c5-4f5722a3bd13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa7f5f-f766-4df3-b32c-02dd14c9cb34]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== disconnect_volume: return (456ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:59:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:59:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:04 user nova-compute[71500]: DEBUG nova.objects.instance [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-96bfda62-1f93-4938-ba26-1621551bbb32 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:05 user nova-compute[71500]: INFO nova.compute.manager [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Detaching volume 60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7
Apr 14 15:59:05 user nova-compute[71500]: INFO nova.virt.block_device [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Attempting to driver detach volume 60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 from mountpoint /dev/vdc
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Attempting to detach device vdc from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:59:05 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:59:05 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:59:05 user nova-compute[71500]:   <target dev="vdc" bus="virtio"/>
Apr 14 15:59:05 user nova-compute[71500]:   <serial>60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7</serial>
Apr 14 15:59:05 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 15:59:05 user nova-compute[71500]: </disk>
Apr 14 15:59:05 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:59:05 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully detached device vdc from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the persistent domain config.
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 15:59:05 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:59:05 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 15:59:05 user nova-compute[71500]:   <target dev="vdc" bus="virtio"/>
Apr 14 15:59:05 user nova-compute[71500]:   <serial>60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7</serial>
Apr 14 15:59:05 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 15:59:05 user nova-compute[71500]: </disk>
Apr 14 15:59:05 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681487945.6004024, e4adfa25-25dc-44d5-9b0e-414185c6bf7c => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 15:59:05 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully detached device vdc from instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c from the live domain config.
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzErPFAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:59:05 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1319dae-83ee-47c8-a16a-8ca4cd6e4dc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:59:05 user nova-compute[71500]: No targets found.
Apr 14 15:59:05 user nova-compute[71500]: iSNS:
Apr 14 15:59:05 user nova-compute[71500]: No targets found.
Apr 14 15:59:05 user nova-compute[71500]: STATIC:
Apr 14 15:59:05 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8
Apr 14 15:59:05 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:59:05 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:59:05 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7
Apr 14 15:59:05 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:59:05 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:59:05 user nova-compute[71500]: FIRMWARE:
Apr 14 15:59:05 user nova-compute[71500]: No targets found.
Apr 14 15:59:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:59:05 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:59:05 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e9cbf-7516-4689-b945-02d5d00511c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7db6e-4fea-4f05-8d84-0f12d52cda32]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:05 user nova-compute[71500]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)
Apr 14 15:59:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:05 user nova-compute[71500]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 (non-flash)
Apr 14 15:59:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadfff18b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[295eb1b1-99c8-439c-90a5-27bce2c60e6a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb52841-6d71-4dfe-9a0a-8f105b3f7769]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b897c436-00fc-4aa4-8d53-a3941a10429a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[797835da-8dfb-44f4-830f-52bf34444a7a]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[db331129-8adc-46cc-b9d0-d1c530ac0e74]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[89533942-43da-4aac-a591-d90831422155]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260]
Apr 14 15:59:05 user nova-compute[71500]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7, portal: 172.16.0.220,3260] successful.
Apr 14 15:59:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60e2fb05-0cc2-42c3-98aa-178c3ae5bdc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ddb41b-233e-4f9a-af81-d50b95bdad27]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] <== disconnect_volume: return (276ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:59:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:59:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'flavor' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-714d3b32-66ab-440a-a58b-470ba05c81b1 tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:07 user nova-compute[71500]: INFO nova.compute.manager [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Terminating instance
Apr 14 15:59:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-changed-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Refreshing instance network info cache due to event network-changed-e3e86dec-e3bf-4584-8918-eb5d22e8428a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG nova.network.neutron [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Refreshing network info cache for port e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Instance destroyed successfully.
Apr 14 15:59:08 user nova-compute[71500]: DEBUG nova.objects.instance [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lazy-loading 'resources' on Instance uuid e4adfa25-25dc-44d5-9b0e-414185c6bf7c {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:56:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-942625841',display_name='tempest-AttachVolumeTestJSON-server-942625841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-942625841',id=29,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCSIAZnoCiRJt45dD0E5xmyyO5lUzvHwlH61yOiQhj4V0wFze8eBEvT7uq5nZcn2ckoN5yUkVVbk6Kf8R6Y+l/LK1oIj6QOlmGmhgF/DWxteCk+8zo62LyLjQwqW9I5Gg==',key_name='tempest-keypair-421873860',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='534f0fb654694b079fa89150594e1bbb',ramdisk_id='',reservation_id='r-jxt5e3zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1357089397',owner_user_name='tempest-AttachVolumeTestJSON-1357089397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b44feacbb8fa4680a965953c122cf31c',uuid=e4adfa25-25dc-44d5-9b0e-414185c6bf7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converting VIF {"id": "62212714-898b-4797-8121-7ff0e3a55c98", "address": "fa:16:3e:d1:55:01", "network": {"id": "a45284f5-dd61-4b82-8470-01fa75cb3923", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-872662703-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "534f0fb654694b079fa89150594e1bbb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62212714-89", "ovs_interfaceid": "62212714-898b-4797-8121-7ff0e3a55c98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG os_vif [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62212714-89, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:59:08 user nova-compute[71500]: INFO os_vif [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:55:01,bridge_name='br-int',has_traffic_filtering=True,id=62212714-898b-4797-8121-7ff0e3a55c98,network=Network(a45284f5-dd61-4b82-8470-01fa75cb3923),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62212714-89')
Apr 14 15:59:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Deleting instance files /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c_del
Apr 14 15:59:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Deletion of /opt/stack/data/nova/instances/e4adfa25-25dc-44d5-9b0e-414185c6bf7c_del complete
Apr 14 15:59:08 user nova-compute[71500]: INFO nova.compute.manager [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 15:59:08 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 15:59:08 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updated VIF entry in instance network info cache for port e3e86dec-e3bf-4584-8918-eb5d22e8428a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7d7625eb-1872-47d0-a99c-eb9fd94e5345 req-f3cf0b05-ece7-4736-9e59-70682a7958aa service nova] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-changed-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Refreshing instance network info cache due to event network-changed-bdc45130-027f-49b1-b33a-2a4adbc70f63. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:59:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Refreshing network info cache for port bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Stashing vm_state: active {{(pid=71500) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_requests' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 15:59:10 user nova-compute[71500]: INFO nova.compute.claims [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Claim successful on node user
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'pci_devices' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:10 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating resource usage from migration e96d6931-5734-44cd-9fc2-7914aa750d07
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:59:10 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Took 1.87 seconds to deallocate network for instance.
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.326s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:10 user nova-compute[71500]: INFO nova.compute.manager [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Migrating
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.027s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updated VIF entry in instance network info cache for port bdc45130-027f-49b1-b33a-2a4adbc70f63. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.network.neutron [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-vif-unplugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] No waiting events found dispatching network-vif-unplugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-vif-unplugged-62212714-898b-4797-8121-7ff0e3a55c98 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Acquiring lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] No waiting events found dispatching network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:59:10 user nova-compute[71500]: WARNING nova.compute.manager [req-c01a71b6-2a14-4d14-a3a4-71b7e09dcd0b req-b41840ba-9844-4c11-b97f-87f2dfe273a6 service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received unexpected event network-vif-plugged-62212714-898b-4797-8121-7ff0e3a55c98 for instance with vm_state active and task_state deleting.
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:10 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Deleted allocations for instance e4adfa25-25dc-44d5-9b0e-414185c6bf7c
Apr 14 15:59:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-42b04c80-3f4c-409c-910c-98f3aee9a73b tempest-AttachVolumeTestJSON-1357089397 tempest-AttachVolumeTestJSON-1357089397-project-member] Lock "e4adfa25-25dc-44d5-9b0e-414185c6bf7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.129s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Starting migrate_disk_and_power_off {{(pid=71500) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-unplugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-unplugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:59:11 user nova-compute[71500]: WARNING nova.compute.manager [req-6b2646ff-735d-4165-a705-130a820faebb req-e3227f5d-4e2e-4aaf-974f-9d608d4a9120 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-unplugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state active and task_state resize_migrating.
Apr 14 15:59:11 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance destroyed successfully.
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-866404495',display_name='tempest-ServerActionsTestJSON-server-866404495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-866404495',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-4vsczczp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:59:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=61119681-6ec1-4dee-bf91-908f479488d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG os_vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdc45130-02, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:59:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:59:11 user nova-compute[71500]: INFO os_vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02')
Apr 14 15:59:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:59:12 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868a5f5-d6ed-4ac9-92b2-e24dbc15af8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 15:59:12 user nova-compute[71500]: No targets found.
Apr 14 15:59:12 user nova-compute[71500]: iSNS:
Apr 14 15:59:12 user nova-compute[71500]: No targets found.
Apr 14 15:59:12 user nova-compute[71500]: STATIC:
Apr 14 15:59:12 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8
Apr 14 15:59:12 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 15:59:12 user nova-compute[71500]:                 Iface Name: default
Apr 14 15:59:12 user nova-compute[71500]: FIRMWARE:
Apr 14 15:59:12 user nova-compute[71500]: No targets found.
Apr 14 15:59:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 15:59:12 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 15:59:12 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd04bd0-eb7a-4da9-a88e-6d57022af63f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-4188aff7-df6d-4ac5-9b76-fe2735020b72 req-3c747084-38f7-40c2-8214-d5d39f88bacc service nova] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Received event network-vif-deleted-62212714-898b-4797-8121-7ff0e3a55c98 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[50322684-0f8a-4998-9709-8d493c4b8e00]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9493a35-e0cb-4674-96b7-a74997edb157]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d03dc0-ea03-4dfb-942b-e5b3a308f66f]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaae042-768d-423b-bfe6-4faf36c55ef0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac31021-01d1-40fa-8ea2-0ada918f6c04]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ff29b391', '/dev/disk/by-id/scsi-1SCST_BIOff29b391-6eca0d399d4dd817', '/dev/disk/by-id/scsi-23665636130643339') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2d27e6-e43e-4270-bf18-d1cdca9da0bd]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a5f46-eec2-4e09-910d-3c074201b040]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5666caa-4de7-4ab9-bb77-1d96cacde14b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]
Apr 14 15:59:12 user nova-compute[71500]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.
Apr 14 15:59:12 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee18e19-f1c1-4bd3-b49a-0307f8cea4a1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (320ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 15:59:12 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Port bdc45130-027f-49b1-b33a-2a4adbc70f63 binding to destination host user is already ACTIVE {{(pid=71500) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:59:13 user nova-compute[71500]: WARNING nova.compute.manager [req-70332508-2bcc-4eb6-9818-cb187d371e0d req-fbab798a-226a-4e8c-9ed3-267681e246e6 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state active and task_state resize_migrated.
Apr 14 15:59:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:59:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG os_brick.utils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3faeb1-8f14-461a-8fc3-ca816d1a74d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5863891-a01f-476c-843b-0d607c233345]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb621a3-f7db-4fd3-94cb-76822c2faa73]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c10a8d-4bc3-4552-b5e5-5612ff22a2cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 15:59:14 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 15:59:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b16fbef-ba77-4b6c-b863-109c455fb74d]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 15:59:14 user nova-compute[71500]: DEBUG os_brick.utils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:59:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Starting finish_migration {{(pid=71500) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance directory exists: not creating {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 15:59:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Creating image(s)
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Ensure instance console log exists: /opt/stack/data/nova/instances/61119681-6ec1-4dee-bf91-908f479488d5/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Start _get_guest_xml network_info=[{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'dc8215ff-5d5b-45fb-8220-c93b6c978ff4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '61119681-6ec1-4dee-bf91-908f479488d5', 'attached_at': '2023-04-14T15:59:19.000000', 'detached_at': '', 'volume_id': '6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'serial': '6e0de370-c626-4a9d-a636-fbb7cfdb81a8'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 15:59:18 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:59:18 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:34:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 15:59:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:59:18 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 15:59:18 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a7940-e9a4-4518-9ab6-a8ec4e79912c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 15:59:18 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[42672ffc-191b-444d-ba15-debb9eea5462]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8] added
Apr 14 15:59:18 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[510fe1f5-7dc1-4a17-aa9e-a41419742dbc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb767d-f6be-4a9e-b207-67ad747c7d1b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytjuFNWr {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ytjuFNWr" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bebf373-3520-4549-9da8-75b0c4a7c051]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ytjuFNWr'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea40be-d32c-4193-87f6-4c69fb5258b9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:18 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c3c683-11bd-4d9e-963c-7cb96785402d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:59:19 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 15:59:19 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:59:19 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 15:59:19 user nova-compute[71500]: 
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e35a0c5-9298-4936-ad1a-41762ffdec28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]
Apr 14 15:59:19 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.
Apr 14 15:59:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a57482-35ae-44e5-a8ff-002c6cea3597]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c42a9b-15a5-4f25-8785-5fcfb8a7e3ed]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 15:59:19 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[53818051-c483-4ae2-bb1c-030dd85cdd25]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 15:59:19 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23665636130643339', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665636130643339', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-866404495',display_name='tempest-ServerActionsTestJSON-server-866404495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-866404495',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-4vsczczp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=61119681-6ec1-4dee-bf91-908f479488d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 15:59:20 user nova-compute[71500]:   <uuid>61119681-6ec1-4dee-bf91-908f479488d5</uuid>
Apr 14 15:59:20 user nova-compute[71500]:   <name>instance-0000001e</name>
Apr 14 15:59:20 user nova-compute[71500]:   <memory>196608</memory>
Apr 14 15:59:20 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 15:59:20 user nova-compute[71500]:   <metadata>
Apr 14 15:59:20 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 15:59:20 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 15:59:20 user nova-compute[71500]:       <nova:name>tempest-ServerActionsTestJSON-server-866404495</nova:name>
Apr 14 15:59:20 user nova-compute[71500]:       <nova:creationTime>2023-04-14 15:59:18</nova:creationTime>
Apr 14 15:59:20 user nova-compute[71500]:       <nova:flavor name="m1.micro">
Apr 14 15:59:20 user nova-compute[71500]:         <nova:memory>192</nova:memory>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 15:59:20 user nova-compute[71500]:       </nova:flavor>
Apr 14 15:59:20 user nova-compute[71500]:       <nova:owner>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:user uuid="3062186c340a4cfe875d5455b0ace246">tempest-ServerActionsTestJSON-649148824-project-member</nova:user>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:project uuid="95e26fa4727e46479d108fe49e225706">tempest-ServerActionsTestJSON-649148824</nova:project>
Apr 14 15:59:20 user nova-compute[71500]:       </nova:owner>
Apr 14 15:59:20 user nova-compute[71500]:       <nova:ports>
Apr 14 15:59:20 user nova-compute[71500]:         <nova:port uuid="bdc45130-027f-49b1-b33a-2a4adbc70f63">
Apr 14 15:59:20 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 15:59:20 user nova-compute[71500]:         </nova:port>
Apr 14 15:59:20 user nova-compute[71500]:       </nova:ports>
Apr 14 15:59:20 user nova-compute[71500]:     </nova:instance>
Apr 14 15:59:20 user nova-compute[71500]:   </metadata>
Apr 14 15:59:20 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 15:59:20 user nova-compute[71500]:     <system>
Apr 14 15:59:20 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 15:59:20 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 15:59:20 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 15:59:20 user nova-compute[71500]:       <entry name="serial">61119681-6ec1-4dee-bf91-908f479488d5</entry>
Apr 14 15:59:20 user nova-compute[71500]:       <entry name="uuid">61119681-6ec1-4dee-bf91-908f479488d5</entry>
Apr 14 15:59:20 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 15:59:20 user nova-compute[71500]:     </system>
Apr 14 15:59:20 user nova-compute[71500]:   </sysinfo>
Apr 14 15:59:20 user nova-compute[71500]:   <os>
Apr 14 15:59:20 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 15:59:20 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 15:59:20 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 15:59:20 user nova-compute[71500]:   </os>
Apr 14 15:59:20 user nova-compute[71500]:   <features>
Apr 14 15:59:20 user nova-compute[71500]:     <acpi/>
Apr 14 15:59:20 user nova-compute[71500]:     <apic/>
Apr 14 15:59:20 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 15:59:20 user nova-compute[71500]:   </features>
Apr 14 15:59:20 user nova-compute[71500]:   <clock offset="utc">
Apr 14 15:59:20 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 15:59:20 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 15:59:20 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 15:59:20 user nova-compute[71500]:   </clock>
Apr 14 15:59:20 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 15:59:20 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 15:59:20 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 15:59:20 user nova-compute[71500]:   </cpu>
Apr 14 15:59:20 user nova-compute[71500]:   <devices>
Apr 14 15:59:20 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 15:59:20 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 15:59:20 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 15:59:20 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 15:59:20 user nova-compute[71500]:       <serial>6e0de370-c626-4a9d-a636-fbb7cfdb81a8</serial>
Apr 14 15:59:20 user nova-compute[71500]:     </disk>
Apr 14 15:59:20 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 15:59:20 user nova-compute[71500]:       <mac address="fa:16:3e:5e:c7:2e"/>
Apr 14 15:59:20 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:59:20 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 15:59:20 user nova-compute[71500]:       <target dev="tapbdc45130-02"/>
Apr 14 15:59:20 user nova-compute[71500]:     </interface>
Apr 14 15:59:20 user nova-compute[71500]:     <serial type="pty">
Apr 14 15:59:20 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/61119681-6ec1-4dee-bf91-908f479488d5/console.log" append="off"/>
Apr 14 15:59:20 user nova-compute[71500]:     </serial>
Apr 14 15:59:20 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 15:59:20 user nova-compute[71500]:     <video>
Apr 14 15:59:20 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 15:59:20 user nova-compute[71500]:     </video>
Apr 14 15:59:20 user nova-compute[71500]:     <rng model="virtio">
Apr 14 15:59:20 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 15:59:20 user nova-compute[71500]:     </rng>
Apr 14 15:59:20 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 15:59:20 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 15:59:20 user nova-compute[71500]:       <stats period="10"/>
Apr 14 15:59:20 user nova-compute[71500]:     </memballoon>
Apr 14 15:59:20 user nova-compute[71500]:   </devices>
Apr 14 15:59:20 user nova-compute[71500]: </domain>
Apr 14 15:59:20 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-866404495',display_name='tempest-ServerActionsTestJSON-server-866404495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-866404495',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-4vsczczp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=61119681-6ec1-4dee-bf91-908f479488d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-197287071-network", "vif_mac": "fa:16:3e:5e:c7:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG os_vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbdc45130-02, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbdc45130-02, col_values=(('external_ids', {'iface-id': 'bdc45130-027f-49b1-b33a-2a4adbc70f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:c7:2e', 'vm-uuid': '61119681-6ec1-4dee-bf91-908f479488d5'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:20 user nova-compute[71500]: INFO os_vif [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02')
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 15:59:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] No VIF found with MAC fa:16:3e:5e:c7:2e, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:21 user nova-compute[71500]: DEBUG nova.compute.manager [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:59:21 user nova-compute[71500]: WARNING nova.compute.manager [req-bee3dc3b-3bbd-4796-a21a-8bc8e416b00a req-6cb449c8-ccb8-43cb-a4ec-a1690b0d78be service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state active and task_state resize_finish.
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681487948.5306993, e4adfa25-25dc-44d5-9b0e-414185c6bf7c => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:59:23 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] VM Stopped (Lifecycle Event)
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.host [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Removed pending event for 61119681-6ec1-4dee-bf91-908f479488d5 due to event {{(pid=71500) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487963.5472167, 61119681-6ec1-4dee-bf91-908f479488d5 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:59:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] VM Resumed (Lifecycle Event)
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-cc6dad6b-8320-4487-9873-46b74c50bdf6 None None] [instance: e4adfa25-25dc-44d5-9b0e-414185c6bf7c] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:59:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance running successfully.
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Failed to set time: agent not configured {{(pid=71500) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-f00ae88d-b4ad-4951-b547-04e02eef712a tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] finish_migration finished successfully. {{(pid=71500) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:59:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681487963.5495908, 61119681-6ec1-4dee-bf91-908f479488d5 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 15:59:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] VM Started (Lifecycle Event)
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 15:59:23 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 15:59:23 user nova-compute[71500]: WARNING nova.compute.manager [req-d1d6feba-38b5-4117-b491-066b150d417b req-2af709ed-ac40-4fbd-83af-655267e453b9 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state resized and task_state None.
Apr 14 15:59:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:49 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 15:59:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 15:59:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 15:59:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:59:54 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8482MB free_disk=26.213626861572266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Applying migration context for instance 61119681-6ec1-4dee-bf91-908f479488d5 as it has an incoming, in-progress migration e96d6931-5734-44cd-9fc2-7914aa750d07. Migration status is finished {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 15:59:54 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating resource usage from migration e96d6931-5734-44cd-9fc2-7914aa750d07
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Migration e96d6931-5734-44cd-9fc2-7914aa750d07 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 61119681-6ec1-4dee-bf91-908f479488d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 15:59:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 15:59:57 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG nova.compute.manager [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing instance network info cache due to event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updated VIF entry in instance network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG nova.network.neutron [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fb746f41-8561-4ad4-82e6-1778ddb16ca4 req-f823d59b-2e3c-4d95-8df8-74e22d6dd558 service nova] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:03 user nova-compute[71500]: INFO nova.compute.manager [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Shelving
Apr 14 16:00:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-unplugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-unplugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:00:04 user nova-compute[71500]: WARNING nova.compute.manager [req-d6b64ede-4d9e-4a09-bed9-8c63ac9082da req-8f43e0f8-ab01-4ea3-9a34-dab42773d94a service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-unplugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state active and task_state shelving.
Apr 14 16:00:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance destroyed successfully.
Apr 14 16:00:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Beginning cold snapshot process
Apr 14 16:00:04 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 16:00:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk /opt/stack/data/nova/instances/snapshots/tmpacxqrwsh/eea40c18b8bd4d72a90852bf544ae041 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk /opt/stack/data/nova/instances/snapshots/tmpacxqrwsh/eea40c18b8bd4d72a90852bf544ae041" returned: 0 in 0.621s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:05 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Snapshot extracted, beginning image upload
Apr 14 16:00:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:00:06 user nova-compute[71500]: WARNING nova.compute.manager [req-9b4db6b1-c712-4721-afef-7fc2988e374e req-f31538a9-df36-4a89-9efb-5ce9c2a8b479 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 16:00:07 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Snapshot image upload complete
Apr 14 16:00:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:00:07 user nova-compute[71500]: INFO nova.compute.manager [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Shelve offloading
Apr 14 16:00:07 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance destroyed successfully.
Apr 14 16:00:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:00:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:07 user nova-compute[71500]: DEBUG nova.network.neutron [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:00:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance destroyed successfully.
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'resources' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1710480109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1710480109',id=31,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBozYjZa3+L7ZaapG78zt//JX1aKtL9gK6w652fgXQCyNWMbZeFs3dLlpUJFQtL9sOYgL2wsRJ8VKTRuUg35WOo6Bi2bKvhvhXZzKawwCATnuTHiTMAKe03Rf2j5CZzitQ==',key_name='tempest-keypair-506635828',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-xsdhc898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member',shelved_at='2023-04-14T16:00:07.791453',shelved_host='user',shelved_image_id='2fef17e0-d7ff-4f13-960f-c7b87c9219f8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=8ebde9c7-b620-4553-856c-c6a3429381b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG os_vif [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7e2966b-fc, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:00:09 user nova-compute[71500]: INFO os_vif [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc')
Apr 14 16:00:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Deleting instance files /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6_del
Apr 14 16:00:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Deletion of /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6_del complete
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing instance network info cache due to event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:00:09 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Deleted allocations for instance 8ebde9c7-b620-4553-856c-c6a3429381b6
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-eeaaab52-c24a-4a0a-b66b-ff86e586736b tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.798s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updated VIF entry in instance network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG nova.network.neutron [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape7e2966b-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-791f7b22-a61f-415d-bd16-9812a3439f87 req-36226335-3b5e-42aa-ab72-85f1c3fea45b service nova] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:19 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488004.5160294, 8ebde9c7-b620-4553-856c-c6a3429381b6 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:00:19 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] VM Stopped (Lifecycle Event)
Apr 14 16:00:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8173a5c3-6ec4-4e98-a670-6fd5ca0d9488 None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:00:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:00:22 user nova-compute[71500]: INFO nova.compute.claims [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Claim successful on node user
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:00:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.policy [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:00:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Creating image(s)
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "/opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk 1073741824" returned: 0 in 0.047s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Cannot resize image /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'migration_context' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Successfully created port: 32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Ensure instance console log exists: /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Successfully updated port: 32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquired lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-changed-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Refreshing instance network info cache due to event network-changed-32081ce5-b63b-4a2d-9150-5c4d235a8b28. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Acquiring lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating instance_info_cache with network_info: [{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Releasing lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Instance network_info: |[{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Acquired lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Refreshing network info cache for port 32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Start _get_guest_xml network_info=[{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:00:24 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:00:24 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-600730661',display_name='tempest-AttachVolumeNegativeTest-server-600730661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-600730661',id=32,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjVuDJ9xVPhnnLm/KZI4BtaCidawIWOhzsM+GSCcr5RyxUk8iD3KwA1Gn1HZBT7OTGIJhfgbWgRizhDxCyb0Dz9e/HVM531L20H+msWPOYrdB5AlRgWeT92c2o/9OGjPg==',key_name='tempest-keypair-93023126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-m840nssl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=85ad8a8f-d9e8-4f74-a16f-449616e970ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'pci_devices' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:00:24 user nova-compute[71500]:   <uuid>85ad8a8f-d9e8-4f74-a16f-449616e970ff</uuid>
Apr 14 16:00:24 user nova-compute[71500]:   <name>instance-00000020</name>
Apr 14 16:00:24 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:00:24 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:00:24 user nova-compute[71500]:   <metadata>
Apr 14 16:00:24 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:00:24 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:00:24 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeNegativeTest-server-600730661</nova:name>
Apr 14 16:00:24 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:00:24</nova:creationTime>
Apr 14 16:00:24 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:00:24 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:00:24 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:00:24 user nova-compute[71500]:       <nova:owner>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:user uuid="2d83796cd8d5464fa4e580844441da81">tempest-AttachVolumeNegativeTest-378331452-project-member</nova:user>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:project uuid="ecb4d204dbf24c19b978456d16d19e87">tempest-AttachVolumeNegativeTest-378331452</nova:project>
Apr 14 16:00:24 user nova-compute[71500]:       </nova:owner>
Apr 14 16:00:24 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:00:24 user nova-compute[71500]:       <nova:ports>
Apr 14 16:00:24 user nova-compute[71500]:         <nova:port uuid="32081ce5-b63b-4a2d-9150-5c4d235a8b28">
Apr 14 16:00:24 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 16:00:24 user nova-compute[71500]:         </nova:port>
Apr 14 16:00:24 user nova-compute[71500]:       </nova:ports>
Apr 14 16:00:24 user nova-compute[71500]:     </nova:instance>
Apr 14 16:00:24 user nova-compute[71500]:   </metadata>
Apr 14 16:00:24 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:00:24 user nova-compute[71500]:     <system>
Apr 14 16:00:24 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:00:24 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:00:24 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:00:24 user nova-compute[71500]:       <entry name="serial">85ad8a8f-d9e8-4f74-a16f-449616e970ff</entry>
Apr 14 16:00:24 user nova-compute[71500]:       <entry name="uuid">85ad8a8f-d9e8-4f74-a16f-449616e970ff</entry>
Apr 14 16:00:24 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:00:24 user nova-compute[71500]:     </system>
Apr 14 16:00:24 user nova-compute[71500]:   </sysinfo>
Apr 14 16:00:24 user nova-compute[71500]:   <os>
Apr 14 16:00:24 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:00:24 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:00:24 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:00:24 user nova-compute[71500]:   </os>
Apr 14 16:00:24 user nova-compute[71500]:   <features>
Apr 14 16:00:24 user nova-compute[71500]:     <acpi/>
Apr 14 16:00:24 user nova-compute[71500]:     <apic/>
Apr 14 16:00:24 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:00:24 user nova-compute[71500]:   </features>
Apr 14 16:00:24 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:00:24 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:00:24 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:00:24 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:00:24 user nova-compute[71500]:   </clock>
Apr 14 16:00:24 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:00:24 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:00:24 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:00:24 user nova-compute[71500]:   </cpu>
Apr 14 16:00:24 user nova-compute[71500]:   <devices>
Apr 14 16:00:24 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:00:24 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:00:24 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk"/>
Apr 14 16:00:24 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:00:24 user nova-compute[71500]:     </disk>
Apr 14 16:00:24 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:00:24 user nova-compute[71500]:       <mac address="fa:16:3e:7c:93:5f"/>
Apr 14 16:00:24 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:00:24 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:00:24 user nova-compute[71500]:       <target dev="tap32081ce5-b6"/>
Apr 14 16:00:24 user nova-compute[71500]:     </interface>
Apr 14 16:00:24 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:00:24 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/console.log" append="off"/>
Apr 14 16:00:24 user nova-compute[71500]:     </serial>
Apr 14 16:00:24 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:00:24 user nova-compute[71500]:     <video>
Apr 14 16:00:24 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:00:24 user nova-compute[71500]:     </video>
Apr 14 16:00:24 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:00:24 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:00:24 user nova-compute[71500]:     </rng>
Apr 14 16:00:24 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:00:24 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:00:24 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:00:24 user nova-compute[71500]:     </memballoon>
Apr 14 16:00:24 user nova-compute[71500]:   </devices>
Apr 14 16:00:24 user nova-compute[71500]: </domain>
Apr 14 16:00:24 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-600730661',display_name='tempest-AttachVolumeNegativeTest-server-600730661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-600730661',id=32,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjVuDJ9xVPhnnLm/KZI4BtaCidawIWOhzsM+GSCcr5RyxUk8iD3KwA1Gn1HZBT7OTGIJhfgbWgRizhDxCyb0Dz9e/HVM531L20H+msWPOYrdB5AlRgWeT92c2o/9OGjPg==',key_name='tempest-keypair-93023126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-m840nssl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=85ad8a8f-d9e8-4f74-a16f-449616e970ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG os_vif [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32081ce5-b6, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32081ce5-b6, col_values=(('external_ids', {'iface-id': '32081ce5-b63b-4a2d-9150-5c4d235a8b28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:93:5f', 'vm-uuid': '85ad8a8f-d9e8-4f74-a16f-449616e970ff'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:24 user nova-compute[71500]: INFO os_vif [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6')
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:7c:93:5f, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updated VIF entry in instance network info cache for port 32081ce5-b63b-4a2d-9150-5c4d235a8b28. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating instance_info_cache with network_info: [{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ce786ec5-f938-4296-9d45-9aa294841cb9 req-d39cd654-0ff6-463f-a4de-77cbd4f190a8 service nova] Releasing lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:26 user nova-compute[71500]: DEBUG nova.compute.manager [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] No waiting events found dispatching network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:00:26 user nova-compute[71500]: WARNING nova.compute.manager [req-77fdf9ff-34eb-40dc-babc-1ec879fc8711 req-fd6ba30f-ca5a-4392-a0c7-af66ad64a3a5 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received unexpected event network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance with vm_state building and task_state spawning.
Apr 14 16:00:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488027.865542, 85ad8a8f-d9e8-4f74-a16f-449616e970ff => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:00:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] VM Resumed (Lifecycle Event)
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:00:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Instance spawned successfully.
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:00:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488027.8696277, 85ad8a8f-d9e8-4f74-a16f-449616e970ff => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:00:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] VM Started (Lifecycle Event)
Apr 14 16:00:27 user nova-compute[71500]: INFO nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Took 5.26 seconds to spawn the instance on the hypervisor.
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:00:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:00:28 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:00:28 user nova-compute[71500]: INFO nova.compute.manager [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Took 5.82 seconds to build instance.
Apr 14 16:00:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6cbf9073-5c7a-4db3-8a11-1ff29329d4fc tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.971s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:00:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] No waiting events found dispatching network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:00:28 user nova-compute[71500]: WARNING nova.compute.manager [req-db777d64-21e8-4da5-817c-c51b25816233 req-7528d496-6b45-4764-95ef-2f08d4886f72 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received unexpected event network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance with vm_state active and task_state None.
Apr 14 16:00:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:46 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:00:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:00:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:00:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:00:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=26.174476623535156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Applying migration context for instance 61119681-6ec1-4dee-bf91-908f479488d5 as it has an incoming, in-progress migration e96d6931-5734-44cd-9fc2-7914aa750d07. Migration status is finished {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 16:00:55 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating resource usage from migration e96d6931-5734-44cd-9fc2-7914aa750d07
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Migration e96d6931-5734-44cd-9fc2-7914aa750d07 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 61119681-6ec1-4dee-bf91-908f479488d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:00:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:00:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:00:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:00:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Going to confirm migration 2 {{(pid=71500) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'info_cache' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'migration_context' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:00:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:01:00 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:01:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:01:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.223s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:01:00 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Deleted allocation for migration e96d6931-5734-44cd-9fc2-7914aa750d07
Apr 14 16:01:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea77ecf7-9ad5-45a3-913b-1951df69871e tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.321s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:01:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [{"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-61119681-6ec1-4dee-bf91-908f479488d5" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:01:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:01:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:01:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:01:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=26.173782348632812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 61119681-6ec1-4dee-bf91-908f479488d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:01:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:01:56 user nova-compute[71500]: INFO nova.compute.manager [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Unshelving
Apr 14 16:01:56 user nova-compute[71500]: INFO nova.virt.block_device [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Booting with volume 72849de7-745e-4d68-b29a-1c64779bbc48 at /dev/vdc
Apr 14 16:01:56 user nova-compute[71500]: DEBUG os_brick.utils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3f9e8d-bb36-42ef-b3ed-fe972ee1c9fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62c8d5-b0fd-4487-8be8-8015017b4911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad67afc-6430-40c9-bd90-2511b6314b66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8cd60-1b1f-471d-8fd5-992f3453f286]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:01:56 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:01:56 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d67dd87-8d6a-48d6-94a9-f4a076c5c9ce]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG os_brick.utils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:01:56 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating existing volume attachment record: 7f5cd307-cf56-4a57-a98a-cb499c646bfe {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:01:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'pci_requests' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:02:01 user nova-compute[71500]: INFO nova.compute.claims [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Claim successful on node user
Apr 14 16:02:01 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:01 user nova-compute[71500]: INFO nova.network.neutron [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating port e7e2966b-fc86-47d5-a656-93ba5e362a42 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 16:02:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing instance network info cache due to event network-changed-e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Acquiring lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:02:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Creating image(s)
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Acquired lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Refreshing network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "bcaf448678d5ba2d392d5ed899fb90aaa727ac36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "bcaf448678d5ba2d392d5ed899fb90aaa727ac36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG nova.virt.images [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 2fef17e0-d7ff-4f13-960f-c7b87c9219f8 was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.part /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.part /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.converted" returned: 0 in 0.185s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updated VIF entry in instance network info cache for port e7e2966b-fc86-47d5-a656-93ba5e362a42. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG nova.network.neutron [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3687d7dc-5c7b-43e8-9f04-f9980de04a96 req-1a6ef236-2b8d-4cce-a4c3-c19ef0578b23 service nova] Releasing lock "refresh_cache-8ebde9c7-b620-4553-856c-c6a3429381b6" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "bcaf448678d5ba2d392d5ed899fb90aaa727ac36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.125s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "bcaf448678d5ba2d392d5ed899fb90aaa727ac36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "bcaf448678d5ba2d392d5ed899fb90aaa727ac36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36,backing_fmt=raw /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36,backing_fmt=raw /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk 1073741824" returned: 0 in 0.047s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "bcaf448678d5ba2d392d5ed899fb90aaa727ac36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:04 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'migration_context' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Rebasing disk image.
Apr 14 16:02:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 -F raw /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 -F raw /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk" returned: 0 in 1.881s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Ensure instance console log exists: /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Start _get_guest_xml network_info=[{"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='2d3c467847e0e464849ce896c0073f19',container_format='bare',created_at=2023-04-14T16:00:04Z,direct_url=<?>,disk_format='qcow2',id=2fef17e0-d7ff-4f13-960f-c7b87c9219f8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1710480109-shelved',owner='b0dd8e5513a94cc8b22c291bac3b066f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T16:00:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '7f5cd307-cf56-4a57-a98a-cb499c646bfe', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbrvVxPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8ebde9c7-b620-4553-856c-c6a3429381b6', 'attached_at': '', 'detached_at': '', 'volume_id': '72849de7-745e-4d68-b29a-1c64779bbc48', 'serial': '72849de7-745e-4d68-b29a-1c64779bbc48'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:02:06 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:02:06 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2d3c467847e0e464849ce896c0073f19',container_format='bare',created_at=2023-04-14T16:00:04Z,direct_url=<?>,disk_format='qcow2',id=2fef17e0-d7ff-4f13-960f-c7b87c9219f8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1710480109-shelved',owner='b0dd8e5513a94cc8b22c291bac3b066f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T16:00:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbrvVxPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:02:06 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:02:06 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:02:06 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6dbb45-0ccd-4e0a-8a91-7d7188371018]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:02:06 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb853a-6bd6-4335-bdf4-b4228337db8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48] added
Apr 14 16:02:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03856f91-e2da-4ce3-9f23-2c54c68da870]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4393c-389f-4e84-9310-1a0fd1664edc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbrvVxPk {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbrvVxPk" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a750c-497a-4e6b-bca3-38ada3245ff0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RbrvVxPk'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c4acb-e63c-489f-a44c-1f55157bb24c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5657d181-3269-44d8-9129-30020d467503]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf709131-7755-4291-9596-7cb87f55ab5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260]
Apr 14 16:02:06 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260] successful.
Apr 14 16:02:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[323ed6c2-7bc8-442f-9081-37cd5d688cc0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf29dc62-732e-4b74-a05e-20862dc7bff9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:06 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:02:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:06 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:02:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[50680b55-e2f9-4217-92ba-6198899abb83]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:02:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbrvVxPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23037373835633566', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037373835633566', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1710480109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1710480109',id=31,image_ref='2fef17e0-d7ff-4f13-960f-c7b87c9219f8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-506635828',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-xsdhc898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member',shelved_at='2023-04-14T16:00:07.791453',shelved_host='user',shelved_image_id='2fef17e0-d7ff-4f13-960f-c7b87c9219f8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=8ebde9c7-b620-4553-856c-c6a3429381b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:02:07 user nova-compute[71500]:   <uuid>8ebde9c7-b620-4553-856c-c6a3429381b6</uuid>
Apr 14 16:02:07 user nova-compute[71500]:   <name>instance-0000001f</name>
Apr 14 16:02:07 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:02:07 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:02:07 user nova-compute[71500]:   <metadata>
Apr 14 16:02:07 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:02:07 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:02:07 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1710480109</nova:name>
Apr 14 16:02:07 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:02:06</nova:creationTime>
Apr 14 16:02:07 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:02:07 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:02:07 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:02:07 user nova-compute[71500]:       <nova:owner>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:user uuid="194adad706f94ef89a86fbcb9d8888ac">tempest-AttachVolumeShelveTestJSON-1653640190-project-member</nova:user>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:project uuid="b0dd8e5513a94cc8b22c291bac3b066f">tempest-AttachVolumeShelveTestJSON-1653640190</nova:project>
Apr 14 16:02:07 user nova-compute[71500]:       </nova:owner>
Apr 14 16:02:07 user nova-compute[71500]:       <nova:root type="image" uuid="2fef17e0-d7ff-4f13-960f-c7b87c9219f8"/>
Apr 14 16:02:07 user nova-compute[71500]:       <nova:ports>
Apr 14 16:02:07 user nova-compute[71500]:         <nova:port uuid="e7e2966b-fc86-47d5-a656-93ba5e362a42">
Apr 14 16:02:07 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 16:02:07 user nova-compute[71500]:         </nova:port>
Apr 14 16:02:07 user nova-compute[71500]:       </nova:ports>
Apr 14 16:02:07 user nova-compute[71500]:     </nova:instance>
Apr 14 16:02:07 user nova-compute[71500]:   </metadata>
Apr 14 16:02:07 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:02:07 user nova-compute[71500]:     <system>
Apr 14 16:02:07 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:02:07 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:02:07 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:02:07 user nova-compute[71500]:       <entry name="serial">8ebde9c7-b620-4553-856c-c6a3429381b6</entry>
Apr 14 16:02:07 user nova-compute[71500]:       <entry name="uuid">8ebde9c7-b620-4553-856c-c6a3429381b6</entry>
Apr 14 16:02:07 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:02:07 user nova-compute[71500]:     </system>
Apr 14 16:02:07 user nova-compute[71500]:   </sysinfo>
Apr 14 16:02:07 user nova-compute[71500]:   <os>
Apr 14 16:02:07 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:02:07 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:02:07 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:02:07 user nova-compute[71500]:   </os>
Apr 14 16:02:07 user nova-compute[71500]:   <features>
Apr 14 16:02:07 user nova-compute[71500]:     <acpi/>
Apr 14 16:02:07 user nova-compute[71500]:     <apic/>
Apr 14 16:02:07 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:02:07 user nova-compute[71500]:   </features>
Apr 14 16:02:07 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:02:07 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:02:07 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:02:07 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:02:07 user nova-compute[71500]:   </clock>
Apr 14 16:02:07 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:02:07 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:02:07 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:02:07 user nova-compute[71500]:   </cpu>
Apr 14 16:02:07 user nova-compute[71500]:   <devices>
Apr 14 16:02:07 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:02:07 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:02:07 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk"/>
Apr 14 16:02:07 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:02:07 user nova-compute[71500]:     </disk>
Apr 14 16:02:07 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:02:07 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:02:07 user nova-compute[71500]:       <source dev="/dev/sdc"/>
Apr 14 16:02:07 user nova-compute[71500]:       <target dev="vdc" bus="virtio"/>
Apr 14 16:02:07 user nova-compute[71500]:       <serial>72849de7-745e-4d68-b29a-1c64779bbc48</serial>
Apr 14 16:02:07 user nova-compute[71500]:     </disk>
Apr 14 16:02:07 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:02:07 user nova-compute[71500]:       <mac address="fa:16:3e:e6:ec:cb"/>
Apr 14 16:02:07 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:02:07 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:02:07 user nova-compute[71500]:       <target dev="tape7e2966b-fc"/>
Apr 14 16:02:07 user nova-compute[71500]:     </interface>
Apr 14 16:02:07 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:02:07 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/console.log" append="off"/>
Apr 14 16:02:07 user nova-compute[71500]:     </serial>
Apr 14 16:02:07 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:02:07 user nova-compute[71500]:     <video>
Apr 14 16:02:07 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:02:07 user nova-compute[71500]:     </video>
Apr 14 16:02:07 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:02:07 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:02:07 user nova-compute[71500]:     </rng>
Apr 14 16:02:07 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:02:07 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:02:07 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:02:07 user nova-compute[71500]:     </memballoon>
Apr 14 16:02:07 user nova-compute[71500]:   </devices>
Apr 14 16:02:07 user nova-compute[71500]: </domain>
Apr 14 16:02:07 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1710480109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1710480109',id=31,image_ref='2fef17e0-d7ff-4f13-960f-c7b87c9219f8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-506635828',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-xsdhc898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member',shelved_at='2023-04-14T16:00:07.791453',shelved_host='user',shelved_image_id='2fef17e0-d7ff-4f13-960f-c7b87c9219f8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=8ebde9c7-b620-4553-856c-c6a3429381b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG os_vif [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7e2966b-fc, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7e2966b-fc, col_values=(('external_ids', {'iface-id': 'e7e2966b-fc86-47d5-a656-93ba5e362a42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:ec:cb', 'vm-uuid': '8ebde9c7-b620-4553-856c-c6a3429381b6'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:07 user nova-compute[71500]: INFO os_vif [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc')
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:02:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No VIF found with MAC fa:16:3e:e6:ec:cb, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:02:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:02:09 user nova-compute[71500]: WARNING nova.compute.manager [req-38e9aaa1-5c79-4b53-973b-141c59d78fad req-9f2729a3-0ff6-40df-af3e-a8d6832b6d9d service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 16:02:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:10 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488130.990029, 8ebde9c7-b620-4553-856c-c6a3429381b6 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:02:10 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] VM Resumed (Lifecycle Event)
Apr 14 16:02:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:02:10 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:02:11 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance spawned successfully.
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:02:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488130.9933112, 8ebde9c7-b620-4553-856c-c6a3429381b6 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:02:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] VM Started (Lifecycle Event)
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:02:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5403fc60-0be0-4043-90fd-4ecb86494753 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.248s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:11 user nova-compute[71500]: DEBUG nova.compute.manager [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:02:11 user nova-compute[71500]: WARNING nova.compute.manager [req-9a44000f-4b00-4ee7-acdf-df5b20ca0c0f req-aebf2e77-20cd-4549-9b27-d773a1ec7fe8 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state active and task_state None.
Apr 14 16:02:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-changed-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:13 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Refreshing instance network info cache due to event network-changed-32081ce5-b63b-4a2d-9150-5c4d235a8b28. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:02:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Acquiring lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:02:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Acquired lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:02:13 user nova-compute[71500]: DEBUG nova.network.neutron [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Refreshing network info cache for port 32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:02:13 user nova-compute[71500]: DEBUG nova.network.neutron [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updated VIF entry in instance network info cache for port 32081ce5-b63b-4a2d-9150-5c4d235a8b28. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:02:14 user nova-compute[71500]: DEBUG nova.network.neutron [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating instance_info_cache with network_info: [{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:02:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb05f30b-c415-4992-a611-2d2d557fe0cc req-96765838-1587-42c0-a814-00315a73c8da service nova] Releasing lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:02:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:15 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:15 user nova-compute[71500]: INFO nova.compute.manager [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Attaching volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f to /dev/vdb
Apr 14 16:02:16 user nova-compute[71500]: DEBUG os_brick.utils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4704375-18d4-4d6b-b0e8-7275642a6fe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91531d18-529e-442c-842e-8c042dbacd36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[24914250-0314-44cf-8b2b-07537c681a79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb7f3b-9f54-465e-81cd-640176e532ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:02:16 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:02:16 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49bf7a-d5f4-4946-802d-9f9edb8fde05]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG os_brick.utils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:02:16 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating existing volume attachment record: 2eaf3245-4ba3-4956-8757-56aa0fe21aae {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:02:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlaIyBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:02:20 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:02:20 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:02:20 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9085eff9-e299-4c44-a8fb-6927e6d383dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:02:20 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6b0551-015b-4d0f-be8d-c7c43c22ea78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f] added
Apr 14 16:02:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[259b5596-9bf2-4cfc-8e82-6dc3d39bb57e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae024c7-567b-4e77-bca8-f29c42665685]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlaIyBJb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlaIyBJb" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7887c461-81cd-4bb7-80ad-bbf7fa2c4d0e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlaIyBJb'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a48c874-74b7-4b0c-b56f-7edecd9b8eda]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9b691-eb88-424f-b8c8-69db6f02f66a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:20 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:02:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:20 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:02:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:02:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93065d0-efb7-48f0-ac3d-94b5d5e561ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260]
Apr 14 16:02:21 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260] successful.
Apr 14 16:02:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58e8703-caec-4779-b7e4-403c2ddf321a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3570ac5-569c-4e7e-a0c1-f0a249a5f78e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:21 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:02:21 user nova-compute[71500]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:02:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:02:21 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:02:21 user nova-compute[71500]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:02:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b64bb77-21d9-491f-bb1e-4ed363bb76bd]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:02:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlaIyBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23266303164633531', 'path': '/dev/sdd'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266303164633531', 'path': '/dev/sdd'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 16:02:22 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:02:22 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 16:02:22 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:02:22 user nova-compute[71500]:   <serial>fb5d8c5d-23ea-40c7-a2de-43e2f431182f</serial>
Apr 14 16:02:22 user nova-compute[71500]: </disk>
Apr 14 16:02:22 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:7c:93:5f, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:02:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ee10c230-2b55-4263-9fbf-96fd033e6d98 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.746s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:02:26 user nova-compute[71500]: INFO nova.compute.claims [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Claim successful on node user
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:02:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.policy [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:02:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Creating image(s)
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk 1073741824" returned: 0 in 0.052s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Successfully created port: 590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Cannot resize image /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'migration_context' on Instance uuid 9f624c54-a234-49d3-9e25-a69043cffd3e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Ensure instance console log exists: /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Successfully updated port: 590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquired lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-changed-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.compute.manager [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Refreshing instance network info cache due to event network-changed-590df74f-db91-4c1b-afb0-0ffce71bb462. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Acquiring lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Updating instance_info_cache with network_info: [{"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Releasing lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Instance network_info: |[{"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Acquired lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Refreshing network info cache for port 590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Start _get_guest_xml network_info=[{"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:02:28 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:02:28 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1992413246',display_name='tempest-AttachVolumeNegativeTest-server-1992413246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1992413246',id=33,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP40xKD98ur0kI+V9xCaxcG20cmbjfHaAwXYdpSj9TibVs8Trhq6MTZRboRCwgFgCFz8qlbNUrAixLlDFRKHxCUZ99Xx1wesGKZNfuWpJeYp/JNKnj6tX64wTpYmZAA/+A==',key_name='tempest-keypair-793451587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-3waih0ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=9f624c54-a234-49d3-9e25-a69043cffd3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f624c54-a234-49d3-9e25-a69043cffd3e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:02:28 user nova-compute[71500]:   <uuid>9f624c54-a234-49d3-9e25-a69043cffd3e</uuid>
Apr 14 16:02:28 user nova-compute[71500]:   <name>instance-00000021</name>
Apr 14 16:02:28 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:02:28 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:02:28 user nova-compute[71500]:   <metadata>
Apr 14 16:02:28 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:02:28 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:02:28 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1992413246</nova:name>
Apr 14 16:02:28 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:02:28</nova:creationTime>
Apr 14 16:02:28 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:02:28 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:02:28 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:02:28 user nova-compute[71500]:       <nova:owner>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:user uuid="2d83796cd8d5464fa4e580844441da81">tempest-AttachVolumeNegativeTest-378331452-project-member</nova:user>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:project uuid="ecb4d204dbf24c19b978456d16d19e87">tempest-AttachVolumeNegativeTest-378331452</nova:project>
Apr 14 16:02:28 user nova-compute[71500]:       </nova:owner>
Apr 14 16:02:28 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:02:28 user nova-compute[71500]:       <nova:ports>
Apr 14 16:02:28 user nova-compute[71500]:         <nova:port uuid="590df74f-db91-4c1b-afb0-0ffce71bb462">
Apr 14 16:02:28 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 16:02:28 user nova-compute[71500]:         </nova:port>
Apr 14 16:02:28 user nova-compute[71500]:       </nova:ports>
Apr 14 16:02:28 user nova-compute[71500]:     </nova:instance>
Apr 14 16:02:28 user nova-compute[71500]:   </metadata>
Apr 14 16:02:28 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:02:28 user nova-compute[71500]:     <system>
Apr 14 16:02:28 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:02:28 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:02:28 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:02:28 user nova-compute[71500]:       <entry name="serial">9f624c54-a234-49d3-9e25-a69043cffd3e</entry>
Apr 14 16:02:28 user nova-compute[71500]:       <entry name="uuid">9f624c54-a234-49d3-9e25-a69043cffd3e</entry>
Apr 14 16:02:28 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:02:28 user nova-compute[71500]:     </system>
Apr 14 16:02:28 user nova-compute[71500]:   </sysinfo>
Apr 14 16:02:28 user nova-compute[71500]:   <os>
Apr 14 16:02:28 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:02:28 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:02:28 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:02:28 user nova-compute[71500]:   </os>
Apr 14 16:02:28 user nova-compute[71500]:   <features>
Apr 14 16:02:28 user nova-compute[71500]:     <acpi/>
Apr 14 16:02:28 user nova-compute[71500]:     <apic/>
Apr 14 16:02:28 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:02:28 user nova-compute[71500]:   </features>
Apr 14 16:02:28 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:02:28 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:02:28 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:02:28 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:02:28 user nova-compute[71500]:   </clock>
Apr 14 16:02:28 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:02:28 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:02:28 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:02:28 user nova-compute[71500]:   </cpu>
Apr 14 16:02:28 user nova-compute[71500]:   <devices>
Apr 14 16:02:28 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:02:28 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:02:28 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk"/>
Apr 14 16:02:28 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:02:28 user nova-compute[71500]:     </disk>
Apr 14 16:02:28 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:02:28 user nova-compute[71500]:       <mac address="fa:16:3e:b4:75:06"/>
Apr 14 16:02:28 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:02:28 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:02:28 user nova-compute[71500]:       <target dev="tap590df74f-db"/>
Apr 14 16:02:28 user nova-compute[71500]:     </interface>
Apr 14 16:02:28 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:02:28 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/console.log" append="off"/>
Apr 14 16:02:28 user nova-compute[71500]:     </serial>
Apr 14 16:02:28 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:02:28 user nova-compute[71500]:     <video>
Apr 14 16:02:28 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:02:28 user nova-compute[71500]:     </video>
Apr 14 16:02:28 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:02:28 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:02:28 user nova-compute[71500]:     </rng>
Apr 14 16:02:28 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:02:28 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:02:28 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:02:28 user nova-compute[71500]:     </memballoon>
Apr 14 16:02:28 user nova-compute[71500]:   </devices>
Apr 14 16:02:28 user nova-compute[71500]: </domain>
Apr 14 16:02:28 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1992413246',display_name='tempest-AttachVolumeNegativeTest-server-1992413246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1992413246',id=33,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP40xKD98ur0kI+V9xCaxcG20cmbjfHaAwXYdpSj9TibVs8Trhq6MTZRboRCwgFgCFz8qlbNUrAixLlDFRKHxCUZ99Xx1wesGKZNfuWpJeYp/JNKnj6tX64wTpYmZAA/+A==',key_name='tempest-keypair-793451587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-3waih0ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=9f624c54-a234-49d3-9e25-a69043cffd3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG os_vif [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap590df74f-db, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap590df74f-db, col_values=(('external_ids', {'iface-id': '590df74f-db91-4c1b-afb0-0ffce71bb462', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:75:06', 'vm-uuid': '9f624c54-a234-49d3-9e25-a69043cffd3e'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:28 user nova-compute[71500]: INFO os_vif [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db')
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:b4:75:06, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Updated VIF entry in instance network info cache for port 590df74f-db91-4c1b-afb0-0ffce71bb462. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG nova.network.neutron [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Updating instance_info_cache with network_info: [{"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:02:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3ba13eef-9e5b-4598-bb50-0b0b4809d5ae req-5e0bb53e-8254-481e-ad01-b5f7be660863 service nova] Releasing lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:02:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] No waiting events found dispatching network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:02:30 user nova-compute[71500]: WARNING nova.compute.manager [req-388166aa-3b94-4ec3-a3a4-fdc9a501e988 req-d9f9c052-738e-436b-806c-634763147317 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received unexpected event network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 for instance with vm_state building and task_state spawning.
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488151.9411712, 9f624c54-a234-49d3-9e25-a69043cffd3e => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:02:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] VM Resumed (Lifecycle Event)
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:02:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Instance spawned successfully.
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:02:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:02:31 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488151.9441922, 9f624c54-a234-49d3-9e25-a69043cffd3e => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:02:31 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] VM Started (Lifecycle Event)
Apr 14 16:02:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:02:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:02:32 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:02:32 user nova-compute[71500]: INFO nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 14 16:02:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:02:32 user nova-compute[71500]: INFO nova.compute.manager [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Took 5.85 seconds to build instance.
Apr 14 16:02:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5809583b-69e4-4aaa-9bdc-d54933df6709 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.947s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:02:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] No waiting events found dispatching network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:02:32 user nova-compute[71500]: WARNING nova.compute.manager [req-639cc854-ce6d-4795-9d7e-9d75ec171122 req-dc7f6285-43a1-4562-acca-0567854827f3 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received unexpected event network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 for instance with vm_state active and task_state None.
Apr 14 16:02:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:45 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:48 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:50 user nova-compute[71500]: INFO nova.compute.manager [None req-f30c2487-4d1d-468b-a4ca-c4acff28363b tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Get console output
Apr 14 16:02:50 user nova-compute[71500]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 16:02:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 16:02:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 16:02:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating instance_info_cache with network_info: [{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:02:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:02:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:02:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8347MB free_disk=26.134037017822266GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 61119681-6ec1-4dee-bf91-908f479488d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9f624c54-a234-49d3-9e25-a69043cffd3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 16:02:55 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:02:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:57 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:57 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:02:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:02:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:03:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:03:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:03:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:03:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:03:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:03:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 9f624c54-a234-49d3-9e25-a69043cffd3e {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "61119681-6ec1-4dee-bf91-908f479488d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "61119681-6ec1-4dee-bf91-908f479488d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:46 user nova-compute[71500]: INFO nova.compute.manager [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Detaching volume 72849de7-745e-4d68-b29a-1c64779bbc48
Apr 14 16:03:46 user nova-compute[71500]: INFO nova.virt.block_device [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Attempting to driver detach volume 72849de7-745e-4d68-b29a-1c64779bbc48 from mountpoint /dev/vdc
Apr 14 16:03:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Attempting to detach device vdc from instance 8ebde9c7-b620-4553-856c-c6a3429381b6 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 16:03:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:03:46 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:03:46 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:03:46 user nova-compute[71500]:   <target dev="vdc" bus="virtio"/>
Apr 14 16:03:46 user nova-compute[71500]:   <serial>72849de7-745e-4d68-b29a-1c64779bbc48</serial>
Apr 14 16:03:46 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 16:03:46 user nova-compute[71500]: </disk>
Apr 14 16:03:46 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:03:46 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully detached device vdc from instance 8ebde9c7-b620-4553-856c-c6a3429381b6 from the persistent domain config.
Apr 14 16:03:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8ebde9c7-b620-4553-856c-c6a3429381b6 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 16:03:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:03:46 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:03:46 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:03:46 user nova-compute[71500]:   <target dev="vdc" bus="virtio"/>
Apr 14 16:03:46 user nova-compute[71500]:   <serial>72849de7-745e-4d68-b29a-1c64779bbc48</serial>
Apr 14 16:03:46 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 16:03:46 user nova-compute[71500]: </disk>
Apr 14 16:03:46 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681488227.0635803, 8ebde9c7-b620-4553-856c-c6a3429381b6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 16:03:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully detached device vdc from instance 8ebde9c7-b620-4553-856c-c6a3429381b6 from the live domain config.
Apr 14 16:03:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbrvVxPk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:03:47 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d60938e-4d9e-4f0b-996d-30025a30e102]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:03:47 user nova-compute[71500]: No targets found.
Apr 14 16:03:47 user nova-compute[71500]: iSNS:
Apr 14 16:03:47 user nova-compute[71500]: No targets found.
Apr 14 16:03:47 user nova-compute[71500]: STATIC:
Apr 14 16:03:47 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8
Apr 14 16:03:47 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:03:47 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:03:47 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f
Apr 14 16:03:47 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:03:47 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:03:47 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48
Apr 14 16:03:47 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:03:47 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:03:47 user nova-compute[71500]: FIRMWARE:
Apr 14 16:03:47 user nova-compute[71500]: No targets found.
Apr 14 16:03:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:03:47 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:03:47 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4f4635-8e7f-41c5-9846-f953ea382515]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[953fd291-c915-4d61-905d-ca4ef937663f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:03:47 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:03:47 user nova-compute[71500]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:03:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:03:47 user nova-compute[71500]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 (non-flash)
Apr 14 16:03:47 user nova-compute[71500]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:03:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc16f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9291f919-31d0-4c33-9a07-02680b6ef2b2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d90c13e-3f52-4f70-a364-9c6fa5ee0252]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[997e2ad0-6fd8-4e5f-86dc-a53c355d21f5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e1bd86-97db-446d-9ff7-534e3acf20a0]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9eb17d-647e-4ce2-a5e1-32639b9ed4df]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54b5e5-1af4-4f16-b824-b7049f6e4b36]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260]
Apr 14 16:03:47 user nova-compute[71500]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48, portal: 172.16.0.220,3260] successful.
Apr 14 16:03:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72849de7-745e-4d68-b29a-1c64779bbc48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c92824d-d5e9-4d19-b703-4f5ddaf243a1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] <== disconnect_volume: return (313ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:03:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'flavor' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cc28aa80-72d8-4737-a788-e62a756cd450 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:03:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:50 user nova-compute[71500]: INFO nova.compute.manager [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Terminating instance
Apr 14 16:03:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:50 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-unplugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-unplugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-428f681a-0ac2-443b-9556-3d456791d5c4 req-97908768-b432-4a98-8412-4c9987d901cd service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-unplugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Instance destroyed successfully.
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid 61119681-6ec1-4dee-bf91-908f479488d5 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-866404495',display_name='tempest-ServerActionsTestJSON-server-866404495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-866404495',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-4vsczczp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=61119681-6ec1-4dee-bf91-908f479488d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "address": "fa:16:3e:5e:c7:2e", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbdc45130-02", "ovs_interfaceid": "bdc45130-027f-49b1-b33a-2a4adbc70f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_vif [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbdc45130-02, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:03:51 user nova-compute[71500]: INFO os_vif [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:c7:2e,bridge_name='br-int',has_traffic_filtering=True,id=bdc45130-027f-49b1-b33a-2a4adbc70f63,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbdc45130-02')
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ytjuFNWr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:03:51 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bae859-e009-417e-9550-9a4609aa7776]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:03:51 user nova-compute[71500]: No targets found.
Apr 14 16:03:51 user nova-compute[71500]: iSNS:
Apr 14 16:03:51 user nova-compute[71500]: No targets found.
Apr 14 16:03:51 user nova-compute[71500]: STATIC:
Apr 14 16:03:51 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8
Apr 14 16:03:51 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:03:51 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:03:51 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f
Apr 14 16:03:51 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:03:51 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:03:51 user nova-compute[71500]: FIRMWARE:
Apr 14 16:03:51 user nova-compute[71500]: No targets found.
Apr 14 16:03:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:03:51 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:03:51 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[743510ae-9d27-4384-a2f0-18a7893ccec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daf66e7-61f4-4aab-9760-153ccda69a6d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:03:51 user nova-compute[71500]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:03:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 (non-flash)
Apr 14 16:03:51 user nova-compute[71500]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:03:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc18dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[841f104f-0777-4610-99f8-31941723f1e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e375c9fe-266e-4dc5-9abd-4f27e6635a45]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a142a29f-87a5-403d-8bbc-8b0a51f57e59]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cef8450-372b-4140-bf74-90f649ce725e]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a003969-75cc-468f-8bfc-fe4a1056cd46]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0c0a0-163d-4bae-a69d-1a21938ae390]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260]
Apr 14 16:03:51 user nova-compute[71500]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8, portal: 172.16.0.220,3260] successful.
Apr 14 16:03:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e0de370-c626-4a9d-a636-fbb7cfdb81a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77f9ce-3750-4388-b30d-4a52d92f3129]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] <== disconnect_volume: return (315ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:03:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Deleting instance files /opt/stack/data/nova/instances/61119681-6ec1-4dee-bf91-908f479488d5_del
Apr 14 16:03:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Deletion of /opt/stack/data/nova/instances/61119681-6ec1-4dee-bf91-908f479488d5_del complete
Apr 14 16:03:51 user nova-compute[71500]: INFO nova.compute.manager [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 16:03:51 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:03:51 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:03:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:03:52 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:03:52 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Took 0.91 seconds to deallocate network for instance.
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-182e63c6-a056-457e-92c4-28286b47269b req-9cb6d665-c332-4cd7-9524-6855835837e7 service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-deleted-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Skipping network cache update for instance because it is being deleted. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Acquiring lock "61119681-6ec1-4dee-bf91-908f479488d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] Lock "61119681-6ec1-4dee-bf91-908f479488d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] No waiting events found dispatching network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:03:53 user nova-compute[71500]: WARNING nova.compute.manager [req-fc09e9be-16ba-457b-88f2-2484ec66103d req-ae6944a9-1e5a-4f6d-baab-8ad67162b56c service nova] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Received unexpected event network-vif-plugged-bdc45130-027f-49b1-b33a-2a4adbc70f63 for instance with vm_state active and task_state deleting.
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [{"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-e0fcb3f5-6676-43a8-b6e2-2da51d195110" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:03:53 user nova-compute[71500]: INFO nova.compute.manager [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Took 0.94 seconds to detach 1 volumes for instance.
Apr 14 16:03:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Deleting volume: 6e0de370-c626-4a9d-a636-fbb7cfdb81a8 {{(pid=71500) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:54 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:03:54 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:03:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:54 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Deleted allocations for instance 61119681-6ec1-4dee-bf91-908f479488d5
Apr 14 16:03:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-37fb9197-64b9-433f-9aed-e04f192b27c4 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "61119681-6ec1-4dee-bf91-908f479488d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.488s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:56 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:03:57 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:03:57 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8451MB free_disk=26.133026123046875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 9f624c54-a234-49d3-9e25-a69043cffd3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:03:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:06 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488231.444095, 61119681-6ec1-4dee-bf91-908f479488d5 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:04:06 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] VM Stopped (Lifecycle Event)
Apr 14 16:04:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-117fb9c3-a340-4e20-b3d5-86e691f01444 None None] [instance: 61119681-6ec1-4dee-bf91-908f479488d5] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:04:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:04:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:04:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:04:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG nova.compute.manager [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-changed-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG nova.compute.manager [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Refreshing instance network info cache due to event network-changed-590df74f-db91-4c1b-afb0-0ffce71bb462. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Acquiring lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Acquired lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG nova.network.neutron [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Refreshing network info cache for port 590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:17 user nova-compute[71500]: INFO nova.compute.manager [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Terminating instance
Apr 14 16:04:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Instance destroyed successfully.
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'resources' on Instance uuid 9f624c54-a234-49d3-9e25-a69043cffd3e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1992413246',display_name='tempest-AttachVolumeNegativeTest-server-1992413246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1992413246',id=33,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP40xKD98ur0kI+V9xCaxcG20cmbjfHaAwXYdpSj9TibVs8Trhq6MTZRboRCwgFgCFz8qlbNUrAixLlDFRKHxCUZ99Xx1wesGKZNfuWpJeYp/JNKnj6tX64wTpYmZAA/+A==',key_name='tempest-keypair-793451587',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-3waih0ox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=9f624c54-a234-49d3-9e25-a69043cffd3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG os_vif [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap590df74f-db, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:18 user nova-compute[71500]: INFO os_vif [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:75:06,bridge_name='br-int',has_traffic_filtering=True,id=590df74f-db91-4c1b-afb0-0ffce71bb462,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap590df74f-db')
Apr 14 16:04:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Deleting instance files /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e_del
Apr 14 16:04:18 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Deletion of /opt/stack/data/nova/instances/9f624c54-a234-49d3-9e25-a69043cffd3e_del complete
Apr 14 16:04:18 user nova-compute[71500]: INFO nova.compute.manager [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 16:04:18 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-vif-unplugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] No waiting events found dispatching network-vif-unplugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.compute.manager [req-fcf6330a-c0e4-4b4f-97c1-fa3c415c2af3 req-5bb08928-610c-4844-ad13-9fc8dce598ba service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-vif-unplugged-590df74f-db91-4c1b-afb0-0ffce71bb462 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.network.neutron [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Updated VIF entry in instance network info cache for port 590df74f-db91-4c1b-afb0-0ffce71bb462. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG nova.network.neutron [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Updating instance_info_cache with network_info: [{"id": "590df74f-db91-4c1b-afb0-0ffce71bb462", "address": "fa:16:3e:b4:75:06", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap590df74f-db", "ovs_interfaceid": "590df74f-db91-4c1b-afb0-0ffce71bb462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-e0798137-d9c8-47d5-b676-7d037d3c2442 req-d671e5b2-cee9-4e37-a6bf-31e21725e16e service nova] Releasing lock "refresh_cache-9f624c54-a234-49d3-9e25-a69043cffd3e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:04:19 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:19 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Took 1.23 seconds to deallocate network for instance.
Apr 14 16:04:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:04:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:04:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:19 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Deleted allocations for instance 9f624c54-a234-49d3-9e25-a69043cffd3e
Apr 14 16:04:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3363a546-fa6c-4022-b4e9-e8cfd68ccf56 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.235s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Acquiring lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] Lock "9f624c54-a234-49d3-9e25-a69043cffd3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] No waiting events found dispatching network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:04:20 user nova-compute[71500]: WARNING nova.compute.manager [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received unexpected event network-vif-plugged-590df74f-db91-4c1b-afb0-0ffce71bb462 for instance with vm_state deleted and task_state None.
Apr 14 16:04:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-166c8781-63d7-45cc-b206-df08e09c7892 req-cbd2e936-b444-4d38-9f4f-168ba5d7ed22 service nova] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Received event network-vif-deleted-590df74f-db91-4c1b-afb0-0ffce71bb462 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488258.1284037, 9f624c54-a234-49d3-9e25-a69043cffd3e => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:04:33 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] VM Stopped (Lifecycle Event)
Apr 14 16:04:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-b52402d8-26ac-4978-9382-3b546001e08f None None] [instance: 9f624c54-a234-49d3-9e25-a69043cffd3e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:04:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:36 user nova-compute[71500]: INFO nova.compute.manager [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Terminating instance
Apr 14 16:04:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-unplugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-unplugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-a061a4f2-1061-40bc-bf35-d26d38bbf083 req-01704b10-c6e6-4a2c-8414-cc0a96c1198b service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-unplugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:04:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Instance destroyed successfully.
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'resources' on Instance uuid 8ebde9c7-b620-4553-856c-c6a3429381b6 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1710480109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1710480109',id=31,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBozYjZa3+L7ZaapG78zt//JX1aKtL9gK6w652fgXQCyNWMbZeFs3dLlpUJFQtL9sOYgL2wsRJ8VKTRuUg35WOo6Bi2bKvhvhXZzKawwCATnuTHiTMAKe03Rf2j5CZzitQ==',key_name='tempest-keypair-506635828',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-xsdhc898',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=8ebde9c7-b620-4553-856c-c6a3429381b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "address": "fa:16:3e:e6:ec:cb", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e2966b-fc", "ovs_interfaceid": "e7e2966b-fc86-47d5-a656-93ba5e362a42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG os_vif [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7e2966b-fc, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:37 user nova-compute[71500]: INFO os_vif [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:ec:cb,bridge_name='br-int',has_traffic_filtering=True,id=e7e2966b-fc86-47d5-a656-93ba5e362a42,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e2966b-fc')
Apr 14 16:04:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Deleting instance files /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6_del
Apr 14 16:04:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Deletion of /opt/stack/data/nova/instances/8ebde9c7-b620-4553-856c-c6a3429381b6_del complete
Apr 14 16:04:37 user nova-compute[71500]: INFO nova.compute.manager [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 16:04:37 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:04:37 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:38 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Took 0.78 seconds to deallocate network for instance.
Apr 14 16:04:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-deleted-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:38 user nova-compute[71500]: INFO nova.compute.manager [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Neutron deleted interface e7e2966b-fc86-47d5-a656-93ba5e362a42; detaching it from the instance and deleting it from the info cache
Apr 14 16:04:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-664b7670-3ba6-4fb1-be42-570cb2dc3523 req-eb168279-2f02-42a6-ada7-276e7666c181 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Detach interface failed, port_id=e7e2966b-fc86-47d5-a656-93ba5e362a42, reason: Instance 8ebde9c7-b620-4553-856c-c6a3429381b6 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:04:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:38 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Deleted allocations for instance 8ebde9c7-b620-4553-856c-c6a3429381b6
Apr 14 16:04:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9f5cf224-44cb-4f0f-afb1-1b22e6c3b728 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Acquiring lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] Lock "8ebde9c7-b620-4553-856c-c6a3429381b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] No waiting events found dispatching network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:04:39 user nova-compute[71500]: WARNING nova.compute.manager [req-35803b3f-2f4b-467e-b5dc-c7ed2de28e76 req-ef0d03cb-2b9f-4541-b730-510c75fe7b88 service nova] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Received unexpected event network-vif-plugged-e7e2966b-fc86-47d5-a656-93ba5e362a42 for instance with vm_state deleted and task_state None.
Apr 14 16:04:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:41 user nova-compute[71500]: INFO nova.compute.manager [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Terminating instance
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-vif-unplugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] No waiting events found dispatching network-vif-unplugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-08b6704b-0bb0-4974-beeb-318fe439f9c4 req-d7de3602-7448-4b10-9848-fe645fb23a0f service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-vif-unplugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Instance destroyed successfully.
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lazy-loading 'resources' on Instance uuid e0fcb3f5-6676-43a8-b6e2-2da51d195110 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T15:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-162942861',display_name='tempest-ServerActionsTestJSON-server-162942861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-162942861',id=27,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIJ8HFkaOtOIdf7E/lF16KDXIPXZxh7OovkjWLEx8f5WDpJK1msPT9bN3Awvpzw6x5igoOwS2qg0f+J4H7MiWfxP/kGOFH6qh+hc6VKWA0LlcFcv57D8gd0WLBvr5/CQw==',key_name='tempest-keypair-2131359708',keypairs=<?>,launch_index=0,launched_at=2023-04-14T15:55:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='95e26fa4727e46479d108fe49e225706',ramdisk_id='',reservation_id='r-occs70iz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-649148824',owner_user_name='tempest-ServerActionsTestJSON-649148824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T15:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3062186c340a4cfe875d5455b0ace246',uuid=e0fcb3f5-6676-43a8-b6e2-2da51d195110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converting VIF {"id": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "address": "fa:16:3e:23:b3:c6", "network": {"id": "b5636fab-ff0a-4313-afb7-6f7fa779e363", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-197287071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "95e26fa4727e46479d108fe49e225706", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3e86dec-e3", "ovs_interfaceid": "e3e86dec-e3bf-4584-8918-eb5d22e8428a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG os_vif [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3e86dec-e3, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:41 user nova-compute[71500]: INFO os_vif [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=e3e86dec-e3bf-4584-8918-eb5d22e8428a,network=Network(b5636fab-ff0a-4313-afb7-6f7fa779e363),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3e86dec-e3')
Apr 14 16:04:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Deleting instance files /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110_del
Apr 14 16:04:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Deletion of /opt/stack/data/nova/instances/e0fcb3f5-6676-43a8-b6e2-2da51d195110_del complete
Apr 14 16:04:42 user nova-compute[71500]: INFO nova.compute.manager [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 14 16:04:42 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:42 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Took 0.49 seconds to deallocate network for instance.
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.compute.manager [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-vif-deleted-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:42 user nova-compute[71500]: INFO nova.compute.manager [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Neutron deleted interface e3e86dec-e3bf-4584-8918-eb5d22e8428a; detaching it from the instance and deleting it from the info cache
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.network.neutron [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.compute.manager [req-1c5074f7-3713-4f93-bd96-4a68f5207d29 req-57e4fffb-d2cf-46fa-864d-616fa2497bd5 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Detach interface failed, port_id=e3e86dec-e3bf-4584-8918-eb5d22e8428a, reason: Instance e0fcb3f5-6676-43a8-b6e2-2da51d195110 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:04:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:42 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Deleted allocations for instance e0fcb3f5-6676-43a8-b6e2-2da51d195110
Apr 14 16:04:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ea94251c-cb84-4f69-bb43-2a5472208b63 tempest-ServerActionsTestJSON-649148824 tempest-ServerActionsTestJSON-649148824-project-member] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.542s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received event network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:04:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Acquiring lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] Lock "e0fcb3f5-6676-43a8-b6e2-2da51d195110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] No waiting events found dispatching network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:04:43 user nova-compute[71500]: WARNING nova.compute.manager [req-ae594e61-b1d5-4599-9e54-bfd310046f7d req-34cdf80d-e631-4e4e-b3fe-158f765d7af9 service nova] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Received unexpected event network-vif-plugged-e3e86dec-e3bf-4584-8918-eb5d22e8428a for instance with vm_state deleted and task_state None.
Apr 14 16:04:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:49 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:04:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:52 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:52 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488277.5997984, 8ebde9c7-b620-4553-856c-c6a3429381b6 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:04:52 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] VM Stopped (Lifecycle Event)
Apr 14 16:04:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-cf7df151-4a2b-465d-afba-1d6abbb34b9d None None] [instance: 8ebde9c7-b620-4553-856c-c6a3429381b6] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating instance_info_cache with network_info: [{"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-85ad8a8f-d9e8-4f74-a16f-449616e970ff" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:04:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:04:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:04:56 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488281.9545443, e0fcb3f5-6676-43a8-b6e2-2da51d195110 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:04:56 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] VM Stopped (Lifecycle Event)
Apr 14 16:04:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8df6d440-d530-49fb-9a58-030964123e41 None None] [instance: e0fcb3f5-6676-43a8-b6e2-2da51d195110] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:04:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:04:58 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:04:58 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:04:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8676MB free_disk=26.19109344482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:04:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:04:59 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:04:59 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:04:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:04:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:05:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:08 user nova-compute[71500]: INFO nova.compute.manager [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Detaching volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f
Apr 14 16:05:08 user nova-compute[71500]: INFO nova.virt.block_device [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Attempting to driver detach volume fb5d8c5d-23ea-40c7-a2de-43e2f431182f from mountpoint /dev/vdb
Apr 14 16:05:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Attempting to detach device vdb from instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 16:05:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:05:08 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:05:08 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 16:05:08 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:05:08 user nova-compute[71500]:   <serial>fb5d8c5d-23ea-40c7-a2de-43e2f431182f</serial>
Apr 14 16:05:08 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:05:08 user nova-compute[71500]: </disk>
Apr 14 16:05:08 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:05:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully detached device vdb from instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff from the persistent domain config.
Apr 14 16:05:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 16:05:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:05:08 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:05:08 user nova-compute[71500]:   <source dev="/dev/sdd"/>
Apr 14 16:05:08 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:05:08 user nova-compute[71500]:   <serial>fb5d8c5d-23ea-40c7-a2de-43e2f431182f</serial>
Apr 14 16:05:08 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:05:08 user nova-compute[71500]: </disk>
Apr 14 16:05:08 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681488309.2594295, 85ad8a8f-d9e8-4f74-a16f-449616e970ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 16:05:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully detached device vdb from instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff from the live domain config.
Apr 14 16:05:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlaIyBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:05:09 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e9873-20a6-4fc8-84d3-aa1a4b763f6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:05:09 user nova-compute[71500]: No targets found.
Apr 14 16:05:09 user nova-compute[71500]: iSNS:
Apr 14 16:05:09 user nova-compute[71500]: No targets found.
Apr 14 16:05:09 user nova-compute[71500]: STATIC:
Apr 14 16:05:09 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f
Apr 14 16:05:09 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:05:09 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:05:09 user nova-compute[71500]: FIRMWARE:
Apr 14 16:05:09 user nova-compute[71500]: No targets found.
Apr 14 16:05:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:05:09 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:05:09 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaaeafd-a15d-4c28-9249-fb03acfe67cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7789c0a-975e-4654-8e91-b5b9b975fc20]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:05:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f (non-flash)
Apr 14 16:05:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadfc0be0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f'): ({'sdd'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Removing single pathed devices sdd {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cc9ec2-8519-4930-a445-5b7596b8dfba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4899c0-18b7-4c9c-ab57-a8368b0b0780]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flushing IO for device /dev/sdd {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad3f034-bbde-4791-a818-a5e24390ae93]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ff4367-2dec-4e5d-8d8f-9c4b19f54f37]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] SCSI volumes sdd have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[974ed7b9-77cd-43dc-8d2b-c574ce48f1a3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[297475ab-dc79-42ab-8140-760d5fb0b2b2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260]
Apr 14 16:05:09 user nova-compute[71500]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f, portal: 172.16.0.220,3260] successful.
Apr 14 16:05:09 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb5d8c5d-23ea-40c7-a2de-43e2f431182f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7362501-8024-4496-8c5d-11485895e6a5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== disconnect_volume: return (261ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:05:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:05:10 user nova-compute[71500]: DEBUG nova.objects.instance [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:05:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-5b7aeb97-58bf-4271-9b2e-ee9582572160 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:05:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:05:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:05:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:05:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:05:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:05:31 user nova-compute[71500]: INFO nova.compute.claims [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Claim successful on node user
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:05:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.policy [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '194adad706f94ef89a86fbcb9d8888ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0dd8e5513a94cc8b22c291bac3b066f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:05:31 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Creating image(s)
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.149s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk 1073741824" returned: 0 in 0.049s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Successfully created port: 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Cannot resize image /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG nova.objects.instance [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'migration_context' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Ensure instance console log exists: /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Successfully updated port: 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.compute.manager [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing instance network info cache due to event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance network_info: |[{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Start _get_guest_xml network_info=[{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:05:33 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:05:33 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-124723558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-124723558',id=34,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNipUVm/SMGITJ/VqIfLO974eqF4qj5uNHbX8svN0zvFZEcFu4uU1z2c8JUk1b8hdRDZntipAlsBEvp03UjR31lBoZlbhXKRg4gjqurx76SHqLWPJwkwrDAXvR7xo0zLAQ==',key_name='tempest-keypair-564331105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-mb4paot8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=89cb156f-a586-4206-b995-999ebca99f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.objects.instance [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:05:33 user nova-compute[71500]:   <uuid>89cb156f-a586-4206-b995-999ebca99f38</uuid>
Apr 14 16:05:33 user nova-compute[71500]:   <name>instance-00000022</name>
Apr 14 16:05:33 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:05:33 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:05:33 user nova-compute[71500]:   <metadata>
Apr 14 16:05:33 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:05:33 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:05:33 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-124723558</nova:name>
Apr 14 16:05:33 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:05:33</nova:creationTime>
Apr 14 16:05:33 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:05:33 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:05:33 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:05:33 user nova-compute[71500]:       <nova:owner>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:user uuid="194adad706f94ef89a86fbcb9d8888ac">tempest-AttachVolumeShelveTestJSON-1653640190-project-member</nova:user>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:project uuid="b0dd8e5513a94cc8b22c291bac3b066f">tempest-AttachVolumeShelveTestJSON-1653640190</nova:project>
Apr 14 16:05:33 user nova-compute[71500]:       </nova:owner>
Apr 14 16:05:33 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:05:33 user nova-compute[71500]:       <nova:ports>
Apr 14 16:05:33 user nova-compute[71500]:         <nova:port uuid="4fb1ed9f-cabd-454e-b69b-96869e3bdc38">
Apr 14 16:05:33 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 16:05:33 user nova-compute[71500]:         </nova:port>
Apr 14 16:05:33 user nova-compute[71500]:       </nova:ports>
Apr 14 16:05:33 user nova-compute[71500]:     </nova:instance>
Apr 14 16:05:33 user nova-compute[71500]:   </metadata>
Apr 14 16:05:33 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:05:33 user nova-compute[71500]:     <system>
Apr 14 16:05:33 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:05:33 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:05:33 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:05:33 user nova-compute[71500]:       <entry name="serial">89cb156f-a586-4206-b995-999ebca99f38</entry>
Apr 14 16:05:33 user nova-compute[71500]:       <entry name="uuid">89cb156f-a586-4206-b995-999ebca99f38</entry>
Apr 14 16:05:33 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:05:33 user nova-compute[71500]:     </system>
Apr 14 16:05:33 user nova-compute[71500]:   </sysinfo>
Apr 14 16:05:33 user nova-compute[71500]:   <os>
Apr 14 16:05:33 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:05:33 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:05:33 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:05:33 user nova-compute[71500]:   </os>
Apr 14 16:05:33 user nova-compute[71500]:   <features>
Apr 14 16:05:33 user nova-compute[71500]:     <acpi/>
Apr 14 16:05:33 user nova-compute[71500]:     <apic/>
Apr 14 16:05:33 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:05:33 user nova-compute[71500]:   </features>
Apr 14 16:05:33 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:05:33 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:05:33 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:05:33 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:05:33 user nova-compute[71500]:   </clock>
Apr 14 16:05:33 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:05:33 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:05:33 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:05:33 user nova-compute[71500]:   </cpu>
Apr 14 16:05:33 user nova-compute[71500]:   <devices>
Apr 14 16:05:33 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:05:33 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:05:33 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk"/>
Apr 14 16:05:33 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:05:33 user nova-compute[71500]:     </disk>
Apr 14 16:05:33 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:05:33 user nova-compute[71500]:       <mac address="fa:16:3e:14:95:05"/>
Apr 14 16:05:33 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:05:33 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:05:33 user nova-compute[71500]:       <target dev="tap4fb1ed9f-ca"/>
Apr 14 16:05:33 user nova-compute[71500]:     </interface>
Apr 14 16:05:33 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:05:33 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/console.log" append="off"/>
Apr 14 16:05:33 user nova-compute[71500]:     </serial>
Apr 14 16:05:33 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:05:33 user nova-compute[71500]:     <video>
Apr 14 16:05:33 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:05:33 user nova-compute[71500]:     </video>
Apr 14 16:05:33 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:05:33 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:05:33 user nova-compute[71500]:     </rng>
Apr 14 16:05:33 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:05:33 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:05:33 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:05:33 user nova-compute[71500]:     </memballoon>
Apr 14 16:05:33 user nova-compute[71500]:   </devices>
Apr 14 16:05:33 user nova-compute[71500]: </domain>
Apr 14 16:05:33 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-124723558',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-124723558',id=34,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNipUVm/SMGITJ/VqIfLO974eqF4qj5uNHbX8svN0zvFZEcFu4uU1z2c8JUk1b8hdRDZntipAlsBEvp03UjR31lBoZlbhXKRg4gjqurx76SHqLWPJwkwrDAXvR7xo0zLAQ==',key_name='tempest-keypair-564331105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-mb4paot8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=89cb156f-a586-4206-b995-999ebca99f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG os_vif [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb1ed9f-ca, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fb1ed9f-ca, col_values=(('external_ids', {'iface-id': '4fb1ed9f-cabd-454e-b69b-96869e3bdc38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:95:05', 'vm-uuid': '89cb156f-a586-4206-b995-999ebca99f38'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:33 user nova-compute[71500]: INFO os_vif [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca')
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No VIF found with MAC fa:16:3e:14:95:05, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated VIF entry in instance network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:05:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9938fd76-5b72-4b00-83c9-5900df325583 req-4ecbc1f4-b89d-4601-b7ba-e7754c835e56 service nova] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:05:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:05:36 user nova-compute[71500]: WARNING nova.compute.manager [req-6b98ed63-08c6-4019-a2b4-5d2d4fb65b06 req-053e495a-00fe-4a50-a9de-f7c56d323f07 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state building and task_state spawning.
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488337.709248, 89cb156f-a586-4206-b995-999ebca99f38 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] VM Resumed (Lifecycle Event)
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance spawned successfully.
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488337.7104754, 89cb156f-a586-4206-b995-999ebca99f38 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] VM Started (Lifecycle Event)
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Took 6.11 seconds to spawn the instance on the hypervisor.
Apr 14 16:05:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:05:37 user nova-compute[71500]: INFO nova.compute.manager [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Took 6.88 seconds to build instance.
Apr 14 16:05:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-004c5b14-c973-4bef-a33b-81d18a22e247 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:05:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:05:38 user nova-compute[71500]: WARNING nova.compute.manager [req-9b80a8b5-db6e-4a1d-abab-70edd9008210 req-ad77e941-af2a-496a-8a28-39c81edfd014 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state active and task_state None.
Apr 14 16:05:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:05:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:05:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:05:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:05:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:51 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:55 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:05:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 16:05:55 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:05:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:05:59 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:05:59 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=26.160526275634766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 89cb156f-a586-4206-b995-999ebca99f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:59 user nova-compute[71500]: INFO nova.compute.manager [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Terminating instance
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-vif-unplugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] No waiting events found dispatching network-vif-unplugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-381543e2-7206-48b5-8b29-c0f53e589dd1 req-0d8a76b3-0d95-4737-87ff-a0b4681f97f0 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-vif-unplugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:05:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:00 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Instance destroyed successfully.
Apr 14 16:06:00 user nova-compute[71500]: DEBUG nova.objects.instance [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'resources' on Instance uuid 85ad8a8f-d9e8-4f74-a16f-449616e970ff {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-600730661',display_name='tempest-AttachVolumeNegativeTest-server-600730661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-600730661',id=32,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjVuDJ9xVPhnnLm/KZI4BtaCidawIWOhzsM+GSCcr5RyxUk8iD3KwA1Gn1HZBT7OTGIJhfgbWgRizhDxCyb0Dz9e/HVM531L20H+msWPOYrdB5AlRgWeT92c2o/9OGjPg==',key_name='tempest-keypair-93023126',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:00:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-m840nssl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=85ad8a8f-d9e8-4f74-a16f-449616e970ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "address": "fa:16:3e:7c:93:5f", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32081ce5-b6", "ovs_interfaceid": "32081ce5-b63b-4a2d-9150-5c4d235a8b28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG os_vif [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32081ce5-b6, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:06:00 user nova-compute[71500]: INFO os_vif [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:93:5f,bridge_name='br-int',has_traffic_filtering=True,id=32081ce5-b63b-4a2d-9150-5c4d235a8b28,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32081ce5-b6')
Apr 14 16:06:00 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Deleting instance files /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff_del
Apr 14 16:06:00 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Deletion of /opt/stack/data/nova/instances/85ad8a8f-d9e8-4f74-a16f-449616e970ff_del complete
Apr 14 16:06:00 user nova-compute[71500]: INFO nova.compute.manager [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 16:06:00 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:06:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:06:01 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Took 0.92 seconds to deallocate network for instance.
Apr 14 16:06:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-81ffe1e5-3bd1-4904-8556-04b7fab8683a req-f80ce610-2a13-428f-b4dd-6067432db267 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-vif-deleted-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:01 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Deleted allocations for instance 85ad8a8f-d9e8-4f74-a16f-449616e970ff
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-92501b3c-4a82-43f3-903e-0606b072522d tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received event network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Acquiring lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] Lock "85ad8a8f-d9e8-4f74-a16f-449616e970ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] No waiting events found dispatching network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:06:01 user nova-compute[71500]: WARNING nova.compute.manager [req-5ab949c8-7064-43a8-bd2f-afd490eb3847 req-79577aa9-3c4b-4396-84ca-2765dc44fd26 service nova] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Received unexpected event network-vif-plugged-32081ce5-b63b-4a2d-9150-5c4d235a8b28 for instance with vm_state deleted and task_state None.
Apr 14 16:06:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488360.0618541, 85ad8a8f-d9e8-4f74-a16f-449616e970ff => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:06:15 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] VM Stopped (Lifecycle Event)
Apr 14 16:06:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-abf19e6e-2ef7-4ed9-896a-402dfff495db None None] [instance: 85ad8a8f-d9e8-4f74-a16f-449616e970ff] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:06:30 user nova-compute[71500]: INFO nova.compute.claims [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Claim successful on node user
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:06:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:06:30 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:06:30 user nova-compute[71500]: INFO nova.virt.block_device [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Booting with volume 2947891b-11ba-4dc1-9435-83fe187e0f04 at /dev/vda
Apr 14 16:06:31 user nova-compute[71500]: DEBUG os_brick.utils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG nova.policy [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca751b25580040a2b48039142c91d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f145f9471aa46ab88e93a9d4c7a4535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a160a-576c-4fb3-854f-1e9d74721bdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc14ef6-97a3-4321-b8a2-8af34d78dbb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a616aeb-513d-4042-b858-5856ffc42073]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3f1e97-e792-490b-9883-33b471241684]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:06:31 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:06:31 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[287cd417-a475-4ba4-b2cb-415b2a7ec39b]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG os_brick.utils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating existing volume attachment record: d6e2bc46-5ef2-46be-9114-cf0bc7bbdf46 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:06:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Successfully created port: f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Successfully updated port: f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing instance network info cache due to event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance network_info: |[{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:06:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:06:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated VIF entry in instance network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:06:33 user nova-compute[71500]: DEBUG nova.network.neutron [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:06:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ae0dbe61-5bc1-409b-b3d1-ba97435ad865 req-1049267c-c968-4e94-b49a-2be47bf1fe0e service nova] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:06:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:06:36 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Creating image(s)
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Ensure instance console log exists: /opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Start _get_guest_xml network_info=[{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'd6e2bc46-5ef2-46be-9114-cf0bc7bbdf46', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fbd3667-302e-4f1f-8e58-2bdabe5efe57', 'attached_at': '', 'detached_at': '', 'volume_id': '2947891b-11ba-4dc1-9435-83fe187e0f04', 'serial': '2947891b-11ba-4dc1-9435-83fe187e0f04'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:06:36 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:06:36 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:06:36 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:06:36 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:06:36 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc91837a-273c-43d6-a645-25e76391dd9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:06:36 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e655e7-2466-4123-b19e-abeaf8e6af65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04] added
Apr 14 16:06:36 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.080s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac4e2f-af5a-48fb-b5e1-a3b0285745df]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0f4bfb-6292-4efc-adfb-86ee1315f1d3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVWPZEQX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVWPZEQX" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3491021e-1107-4cc7-926e-e0f74b9d2210]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVWPZEQX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[22814b76-393a-46e4-a266-264f131ec7ca]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1621bf07-e628-4ac5-976f-92f46487512c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:06:36 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:06:36 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:06:36 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:06:36 user nova-compute[71500]: 
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884674a-ede4-419b-90be-4a89145f1c78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]
Apr 14 16:06:36 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.
Apr 14 16:06:36 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c15042-decc-4907-b20d-3fdb00d40f64]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b101877e-acc7-4582-b564-e5191e56eb9a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:06:36 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:06:36 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96eeb59-5144-42f0-a345-2b5346a397c7]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:06:36 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23361326138343830', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361326138343830', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-491913355',display_name='tempest-TestShelveInstance-server-491913355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-491913355',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIVqE9fEVycFAK+Gh/+LweMpamRDIGnhFfG42+5HdOWX1XdC8hGLSoifG92sxHHVA8mRsvZgr42YuaW4sLfHJ80/IMh3TNaLl+E7j32V5F75cszy3PrR7bTxzkPUUbDYg==',key_name='tempest-TestShelveInstance-163308382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f145f9471aa46ab88e93a9d4c7a4535',ramdisk_id='',reservation_id='r-s61xjs93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1830025798',owner_user_name='tempest-TestShelveInstance-1830025798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:06:31Z,user_data=None,user_id='ca751b25580040a2b48039142c91d58f',uuid=8fbd3667-302e-4f1f-8e58-2bdabe5efe57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converting VIF {"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:06:37 user nova-compute[71500]:   <uuid>8fbd3667-302e-4f1f-8e58-2bdabe5efe57</uuid>
Apr 14 16:06:37 user nova-compute[71500]:   <name>instance-00000023</name>
Apr 14 16:06:37 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:06:37 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:06:37 user nova-compute[71500]:   <metadata>
Apr 14 16:06:37 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:06:37 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:06:37 user nova-compute[71500]:       <nova:name>tempest-TestShelveInstance-server-491913355</nova:name>
Apr 14 16:06:37 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:06:36</nova:creationTime>
Apr 14 16:06:37 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:06:37 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:06:37 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:06:37 user nova-compute[71500]:       <nova:owner>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:user uuid="ca751b25580040a2b48039142c91d58f">tempest-TestShelveInstance-1830025798-project-member</nova:user>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:project uuid="0f145f9471aa46ab88e93a9d4c7a4535">tempest-TestShelveInstance-1830025798</nova:project>
Apr 14 16:06:37 user nova-compute[71500]:       </nova:owner>
Apr 14 16:06:37 user nova-compute[71500]:       <nova:ports>
Apr 14 16:06:37 user nova-compute[71500]:         <nova:port uuid="f572c852-fb5c-4ceb-aac4-4be593331f83">
Apr 14 16:06:37 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 16:06:37 user nova-compute[71500]:         </nova:port>
Apr 14 16:06:37 user nova-compute[71500]:       </nova:ports>
Apr 14 16:06:37 user nova-compute[71500]:     </nova:instance>
Apr 14 16:06:37 user nova-compute[71500]:   </metadata>
Apr 14 16:06:37 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:06:37 user nova-compute[71500]:     <system>
Apr 14 16:06:37 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:06:37 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:06:37 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:06:37 user nova-compute[71500]:       <entry name="serial">8fbd3667-302e-4f1f-8e58-2bdabe5efe57</entry>
Apr 14 16:06:37 user nova-compute[71500]:       <entry name="uuid">8fbd3667-302e-4f1f-8e58-2bdabe5efe57</entry>
Apr 14 16:06:37 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:06:37 user nova-compute[71500]:     </system>
Apr 14 16:06:37 user nova-compute[71500]:   </sysinfo>
Apr 14 16:06:37 user nova-compute[71500]:   <os>
Apr 14 16:06:37 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:06:37 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:06:37 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:06:37 user nova-compute[71500]:   </os>
Apr 14 16:06:37 user nova-compute[71500]:   <features>
Apr 14 16:06:37 user nova-compute[71500]:     <acpi/>
Apr 14 16:06:37 user nova-compute[71500]:     <apic/>
Apr 14 16:06:37 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:06:37 user nova-compute[71500]:   </features>
Apr 14 16:06:37 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:06:37 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:06:37 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:06:37 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:06:37 user nova-compute[71500]:   </clock>
Apr 14 16:06:37 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:06:37 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:06:37 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:06:37 user nova-compute[71500]:   </cpu>
Apr 14 16:06:37 user nova-compute[71500]:   <devices>
Apr 14 16:06:37 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:06:37 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:06:37 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 16:06:37 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:06:37 user nova-compute[71500]:       <serial>2947891b-11ba-4dc1-9435-83fe187e0f04</serial>
Apr 14 16:06:37 user nova-compute[71500]:     </disk>
Apr 14 16:06:37 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:06:37 user nova-compute[71500]:       <mac address="fa:16:3e:60:38:4e"/>
Apr 14 16:06:37 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:06:37 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:06:37 user nova-compute[71500]:       <target dev="tapf572c852-fb"/>
Apr 14 16:06:37 user nova-compute[71500]:     </interface>
Apr 14 16:06:37 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:06:37 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/console.log" append="off"/>
Apr 14 16:06:37 user nova-compute[71500]:     </serial>
Apr 14 16:06:37 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:06:37 user nova-compute[71500]:     <video>
Apr 14 16:06:37 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:06:37 user nova-compute[71500]:     </video>
Apr 14 16:06:37 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:06:37 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:06:37 user nova-compute[71500]:     </rng>
Apr 14 16:06:37 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:06:37 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:06:37 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:06:37 user nova-compute[71500]:     </memballoon>
Apr 14 16:06:37 user nova-compute[71500]:   </devices>
Apr 14 16:06:37 user nova-compute[71500]: </domain>
Apr 14 16:06:37 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-491913355',display_name='tempest-TestShelveInstance-server-491913355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-491913355',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIVqE9fEVycFAK+Gh/+LweMpamRDIGnhFfG42+5HdOWX1XdC8hGLSoifG92sxHHVA8mRsvZgr42YuaW4sLfHJ80/IMh3TNaLl+E7j32V5F75cszy3PrR7bTxzkPUUbDYg==',key_name='tempest-TestShelveInstance-163308382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f145f9471aa46ab88e93a9d4c7a4535',ramdisk_id='',reservation_id='r-s61xjs93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1830025798',owner_user_name='tempest-TestShelveInstance-1830025798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:06:31Z,user_data=None,user_id='ca751b25580040a2b48039142c91d58f',uuid=8fbd3667-302e-4f1f-8e58-2bdabe5efe57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converting VIF {"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG os_vif [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf572c852-fb, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf572c852-fb, col_values=(('external_ids', {'iface-id': 'f572c852-fb5c-4ceb-aac4-4be593331f83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:38:4e', 'vm-uuid': '8fbd3667-302e-4f1f-8e58-2bdabe5efe57'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:37 user nova-compute[71500]: INFO os_vif [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb')
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:06:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] No VIF found with MAC fa:16:3e:60:38:4e, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:06:39 user nova-compute[71500]: WARNING nova.compute.manager [req-6d4ae6b7-d601-4cfe-9343-cd798a426824 req-773e8e1f-e675-4bd6-bae0-5341816bb0e1 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state building and task_state spawning.
Apr 14 16:06:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488401.1405618, 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] VM Resumed (Lifecycle Event)
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance spawned successfully.
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488401.142013, 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] VM Started (Lifecycle Event)
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Took 5.20 seconds to spawn the instance on the hypervisor.
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:41 user nova-compute[71500]: INFO nova.compute.manager [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Took 10.79 seconds to build instance.
Apr 14 16:06:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9e9d8611-3f35-4c99-a858-e64f178e5dae tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.884s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:06:41 user nova-compute[71500]: WARNING nova.compute.manager [req-8f505824-f87f-4493-9252-d9680e99d80b req-d0f7a106-31ab-4c84-9795-b21b215e5541 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state None.
Apr 14 16:06:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:06:53 user nova-compute[71500]: INFO nova.compute.claims [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Claim successful on node user
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:06:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.policy [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:06:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Creating image(s)
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "/opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk 1073741824" returned: 0 in 0.068s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Cannot resize image /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.objects.instance [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'migration_context' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Ensure instance console log exists: /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Successfully created port: 36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Successfully updated port: 36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquired lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:06:54 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.compute.manager [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-changed-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.compute.manager [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Refreshing instance network info cache due to event network-changed-36f4a46b-0cb2-4a15-b995-43b84aa8d86a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Acquiring lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updating instance_info_cache with network_info: [{"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Releasing lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Instance network_info: |[{"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Acquired lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.neutron [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Refreshing network info cache for port 36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Start _get_guest_xml network_info=[{"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:06:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:06:55 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-968788151',display_name='tempest-AttachVolumeNegativeTest-server-968788151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-968788151',id=36,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQGyEZxcMTFif2Fb0VzDaFXGQPiXG8GLAWmvhsMb1cuzmisMXAkf9eWnBOu3OuqWPsVR66YcTHn/BD+yPOOCjhzbuxyiGr8oalwYLWVgmWBAGVr6EoWbycD+FNaOa84A==',key_name='tempest-keypair-388847104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-u1cm2yto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=971c41c2-4757-4a9c-bef7-aff8b6386611,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.objects.instance [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'pci_devices' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:06:55 user nova-compute[71500]:   <uuid>971c41c2-4757-4a9c-bef7-aff8b6386611</uuid>
Apr 14 16:06:55 user nova-compute[71500]:   <name>instance-00000024</name>
Apr 14 16:06:55 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:06:55 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:06:55 user nova-compute[71500]:   <metadata>
Apr 14 16:06:55 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:06:55 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:06:55 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeNegativeTest-server-968788151</nova:name>
Apr 14 16:06:55 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:06:55</nova:creationTime>
Apr 14 16:06:55 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:06:55 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:06:55 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:06:55 user nova-compute[71500]:       <nova:owner>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:user uuid="2d83796cd8d5464fa4e580844441da81">tempest-AttachVolumeNegativeTest-378331452-project-member</nova:user>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:project uuid="ecb4d204dbf24c19b978456d16d19e87">tempest-AttachVolumeNegativeTest-378331452</nova:project>
Apr 14 16:06:55 user nova-compute[71500]:       </nova:owner>
Apr 14 16:06:55 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:06:55 user nova-compute[71500]:       <nova:ports>
Apr 14 16:06:55 user nova-compute[71500]:         <nova:port uuid="36f4a46b-0cb2-4a15-b995-43b84aa8d86a">
Apr 14 16:06:55 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 16:06:55 user nova-compute[71500]:         </nova:port>
Apr 14 16:06:55 user nova-compute[71500]:       </nova:ports>
Apr 14 16:06:55 user nova-compute[71500]:     </nova:instance>
Apr 14 16:06:55 user nova-compute[71500]:   </metadata>
Apr 14 16:06:55 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:06:55 user nova-compute[71500]:     <system>
Apr 14 16:06:55 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:06:55 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:06:55 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:06:55 user nova-compute[71500]:       <entry name="serial">971c41c2-4757-4a9c-bef7-aff8b6386611</entry>
Apr 14 16:06:55 user nova-compute[71500]:       <entry name="uuid">971c41c2-4757-4a9c-bef7-aff8b6386611</entry>
Apr 14 16:06:55 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:06:55 user nova-compute[71500]:     </system>
Apr 14 16:06:55 user nova-compute[71500]:   </sysinfo>
Apr 14 16:06:55 user nova-compute[71500]:   <os>
Apr 14 16:06:55 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:06:55 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:06:55 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:06:55 user nova-compute[71500]:   </os>
Apr 14 16:06:55 user nova-compute[71500]:   <features>
Apr 14 16:06:55 user nova-compute[71500]:     <acpi/>
Apr 14 16:06:55 user nova-compute[71500]:     <apic/>
Apr 14 16:06:55 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:06:55 user nova-compute[71500]:   </features>
Apr 14 16:06:55 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:06:55 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:06:55 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:06:55 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:06:55 user nova-compute[71500]:   </clock>
Apr 14 16:06:55 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:06:55 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:06:55 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:06:55 user nova-compute[71500]:   </cpu>
Apr 14 16:06:55 user nova-compute[71500]:   <devices>
Apr 14 16:06:55 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:06:55 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:06:55 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk"/>
Apr 14 16:06:55 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:06:55 user nova-compute[71500]:     </disk>
Apr 14 16:06:55 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:06:55 user nova-compute[71500]:       <mac address="fa:16:3e:e8:40:4d"/>
Apr 14 16:06:55 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:06:55 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:06:55 user nova-compute[71500]:       <target dev="tap36f4a46b-0c"/>
Apr 14 16:06:55 user nova-compute[71500]:     </interface>
Apr 14 16:06:55 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:06:55 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/console.log" append="off"/>
Apr 14 16:06:55 user nova-compute[71500]:     </serial>
Apr 14 16:06:55 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:06:55 user nova-compute[71500]:     <video>
Apr 14 16:06:55 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:06:55 user nova-compute[71500]:     </video>
Apr 14 16:06:55 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:06:55 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:06:55 user nova-compute[71500]:     </rng>
Apr 14 16:06:55 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:06:55 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:06:55 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:06:55 user nova-compute[71500]:     </memballoon>
Apr 14 16:06:55 user nova-compute[71500]:   </devices>
Apr 14 16:06:55 user nova-compute[71500]: </domain>
Apr 14 16:06:55 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-968788151',display_name='tempest-AttachVolumeNegativeTest-server-968788151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-968788151',id=36,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQGyEZxcMTFif2Fb0VzDaFXGQPiXG8GLAWmvhsMb1cuzmisMXAkf9eWnBOu3OuqWPsVR66YcTHn/BD+yPOOCjhzbuxyiGr8oalwYLWVgmWBAGVr6EoWbycD+FNaOa84A==',key_name='tempest-keypair-388847104',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-u1cm2yto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:06:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=971c41c2-4757-4a9c-bef7-aff8b6386611,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG os_vif [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f4a46b-0c, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36f4a46b-0c, col_values=(('external_ids', {'iface-id': '36f4a46b-0cb2-4a15-b995-43b84aa8d86a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:40:4d', 'vm-uuid': '971c41c2-4757-4a9c-bef7-aff8b6386611'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:55 user nova-compute[71500]: INFO os_vif [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c')
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:06:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:e8:40:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Skipping network cache update for instance because it is Building. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updated VIF entry in instance network info cache for port 36f4a46b-0cb2-4a15-b995-43b84aa8d86a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.network.neutron [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updating instance_info_cache with network_info: [{"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6cecae03-255a-4885-9186-6ada0413b575 req-45822921-fafe-407f-b541-d68681c7e484 service nova] Releasing lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] No waiting events found dispatching network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:06:57 user nova-compute[71500]: WARNING nova.compute.manager [req-7432fc90-222f-4ee4-8672-c04e078e72fa req-baa71c4b-66d1-4cc8-b492-1dbf27ad5f80 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received unexpected event network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance with vm_state building and task_state spawning.
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:06:58 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:06:59 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:06:59 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8486MB free_disk=26.16757583618164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 89cb156f-a586-4206-b995-999ebca99f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] No waiting events found dispatching network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:06:59 user nova-compute[71500]: WARNING nova.compute.manager [req-27390f0c-d1a0-488f-aa47-79005ae089b4 req-519c0cd2-7614-4155-9f43-8d92688ead5c service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received unexpected event network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance with vm_state building and task_state spawning.
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488419.3483768, 971c41c2-4757-4a9c-bef7-aff8b6386611 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] VM Resumed (Lifecycle Event)
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Instance spawned successfully.
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488419.3534148, 971c41c2-4757-4a9c-bef7-aff8b6386611 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] VM Started (Lifecycle Event)
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 14 16:06:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:06:59 user nova-compute[71500]: INFO nova.compute.manager [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Took 6.56 seconds to build instance.
Apr 14 16:06:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7e09c970-6b4e-4138-b80f-2b16dfc9e0c8 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.716s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:06:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing instance network info cache due to event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated VIF entry in instance network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:07:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9371a247-ddac-432d-9e81-5366b7562781 req-3ea23bc1-e1c5-42c3-8b5a-84599063f487 service nova] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:07:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:07:25 user nova-compute[71500]: INFO nova.compute.manager [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Shelving
Apr 14 16:07:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-unplugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:07:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-unplugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:07:25 user nova-compute[71500]: WARNING nova.compute.manager [req-1e471187-0c36-42d9-9c8e-f4b7bc49491c req-74df639c-175e-4658-ac00-d50ee62a2efe service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-unplugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state active and task_state shelving.
Apr 14 16:07:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance destroyed successfully.
Apr 14 16:07:26 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Beginning cold snapshot process
Apr 14 16:07:26 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 16:07:26 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk /opt/stack/data/nova/instances/snapshots/tmp6gent0ix/73a051facb7b46a39a68eaf3f3b47796 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:07:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk /opt/stack/data/nova/instances/snapshots/tmp6gent0ix/73a051facb7b46a39a68eaf3f3b47796" returned: 0 in 0.329s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:07:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Snapshot extracted, beginning image upload
Apr 14 16:07:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:07:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:07:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:07:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:07:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:07:27 user nova-compute[71500]: WARNING nova.compute.manager [req-9c511ece-d57e-4ade-ab2c-1d97d43ddb9b req-8b745052-264b-4a72-b3b4-2eaedf010e0f service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 16:07:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Snapshot image upload complete
Apr 14 16:07:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:07:29 user nova-compute[71500]: INFO nova.compute.manager [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Shelve offloading
Apr 14 16:07:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance destroyed successfully.
Apr 14 16:07:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:07:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:07:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:07:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:07:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:07:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:07:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance destroyed successfully.
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'resources' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-124723558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-124723558',id=34,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNipUVm/SMGITJ/VqIfLO974eqF4qj5uNHbX8svN0zvFZEcFu4uU1z2c8JUk1b8hdRDZntipAlsBEvp03UjR31lBoZlbhXKRg4gjqurx76SHqLWPJwkwrDAXvR7xo0zLAQ==',key_name='tempest-keypair-564331105',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:05:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-mb4paot8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member',shelved_at='2023-04-14T16:07:29.092867',shelved_host='user',shelved_image_id='51eb1050-a60f-4548-b6cf-81ffbcf2e3bc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=89cb156f-a586-4206-b995-999ebca99f38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG os_vif [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb1ed9f-ca, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing instance network info cache due to event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:07:30 user nova-compute[71500]: INFO os_vif [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca')
Apr 14 16:07:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Deleting instance files /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38_del
Apr 14 16:07:30 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Deletion of /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38_del complete
Apr 14 16:07:30 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Deleted allocations for instance 89cb156f-a586-4206-b995-999ebca99f38
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'numa_topology' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d739a766-8889-41bb-aeb5-04f0b0d0c899 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.229s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated VIF entry in instance network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:07:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f036d3fe-8cd9-4b64-b89a-fbaab6d2ebcd req-027df10e-2bd6-4673-b5e8-811a87f9b3a0 service nova] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:07:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4991-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:07:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:41 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488446.3673534, 89cb156f-a586-4206-b995-999ebca99f38 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:07:41 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] VM Stopped (Lifecycle Event)
Apr 14 16:07:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-36625aed-7e69-4123-9ac6-b604c8f199dc None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:07:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:07:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:07:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:07:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:07:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:07:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:53 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:07:55 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:07:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:07:59 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:07:59 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=26.13034439086914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:07:59 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:08:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 16:08:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 16:08:04 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:08:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:08:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:08:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:08:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:08:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing instance network info cache due to event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG nova.network.neutron [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:22 user nova-compute[71500]: INFO nova.compute.manager [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Shelve offloading
Apr 14 16:08:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:08:23 user nova-compute[71500]: WARNING nova.compute.manager [req-930173e4-c679-4a69-9751-9323a6ae9e4f req-5e408056-5ad4-4f0b-8f61-b7a98ed83c9d service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state shelving.
Apr 14 16:08:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated VIF entry in instance network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG nova.network.neutron [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a412b9a-468a-44a2-b433-bd2d4578e56f req-9f28b870-2276-4123-9253-8bbf941f8c4a service nova] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:08:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance destroyed successfully.
Apr 14 16:08:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:08:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance destroyed successfully.
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'resources' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-491913355',display_name='tempest-TestShelveInstance-server-491913355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-491913355',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIVqE9fEVycFAK+Gh/+LweMpamRDIGnhFfG42+5HdOWX1XdC8hGLSoifG92sxHHVA8mRsvZgr42YuaW4sLfHJ80/IMh3TNaLl+E7j32V5F75cszy3PrR7bTxzkPUUbDYg==',key_name='tempest-TestShelveInstance-163308382',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f145f9471aa46ab88e93a9d4c7a4535',ramdisk_id='',reservation_id='r-s61xjs93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1830025798',owner_user_name='tempest-TestShelveInstance-1830025798-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:06:41Z,user_data=None,user_id='ca751b25580040a2b48039142c91d58f',uuid=8fbd3667-302e-4f1f-8e58-2bdabe5efe57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converting VIF {"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_vif [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf572c852-fb, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:08:24 user nova-compute[71500]: INFO os_vif [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb')
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:08:24 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.compute.manager [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing instance network info cache due to event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fdd3e4-2de2-4a8e-a533-1b06cd564f96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:08:24 user nova-compute[71500]: No targets found.
Apr 14 16:08:24 user nova-compute[71500]: iSNS:
Apr 14 16:08:24 user nova-compute[71500]: No targets found.
Apr 14 16:08:24 user nova-compute[71500]: STATIC:
Apr 14 16:08:24 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04
Apr 14 16:08:24 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:08:24 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:08:24 user nova-compute[71500]: FIRMWARE:
Apr 14 16:08:24 user nova-compute[71500]: No targets found.
Apr 14 16:08:24 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:08:24 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:08:24 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4126f8-90cc-4a98-82bb-b4ece6301142]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909623a-6dce-4f65-843e-481f03c900a7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:08:24 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:08:24 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc63fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:08:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[54489749-d90a-49f9-94f3-52dfbd3ad31c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c3ddd7-0658-49ce-817e-f053b464bee4]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabca927-3aa9-42cb-8768-0308b8de6b85]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[995d20ef-173f-490c-9764-6aebe19bba00]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1474a94-6c71-4064-9c89-b60545857df1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[97380483-b476-4c38-a761-3b4f9a1bdc4d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]
Apr 14 16:08:25 user nova-compute[71500]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.
Apr 14 16:08:25 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:08:25 user nova-compute[71500]: WARNING nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state shelving.
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:08:25 user nova-compute[71500]: WARNING nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state shelving.
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:08:25 user nova-compute[71500]: WARNING nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state shelving.
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:08:25 user nova-compute[71500]: WARNING nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state shelving.
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:08:25 user nova-compute[71500]: WARNING nova.compute.manager [req-d302f243-3da6-454c-b66a-f785372c06ce req-823a568f-c5a6-4a74-90aa-908e946e8fe9 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state shelving.
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[88155012-f8be-4aa9-baea-081e37750894]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] <== disconnect_volume: return (304ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:08:25 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Deleting instance files /opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57_del
Apr 14 16:08:25 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Deletion of /opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57_del complete
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated VIF entry in instance network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": null, "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf572c852-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:08:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-596fcf83-99fd-4b01-a694-f59df64cb57c req-2e05c503-c522-4a3f-8862-474d1d8ac6b3 service nova] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:08:26 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Deleted allocations for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57
Apr 14 16:08:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:26 user nova-compute[71500]: DEBUG nova.objects.instance [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:08:26 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:08:26 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:08:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-839e85b0-a0ca-47d5-95a5-225189ce783a tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.565s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:38 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488503.6338608, 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:08:38 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] VM Stopped (Lifecycle Event)
Apr 14 16:08:38 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c8b2e019-74b1-449e-aaf9-2e836823bbae None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:08:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG nova.compute.manager [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-changed-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG nova.compute.manager [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Refreshing instance network info cache due to event network-changed-36f4a46b-0cb2-4a15-b995-43b84aa8d86a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Acquiring lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Acquired lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Refreshing network info cache for port 36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updated VIF entry in instance network info cache for port 36f4a46b-0cb2-4a15-b995-43b84aa8d86a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updating instance_info_cache with network_info: [{"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8d4d0e68-5344-461f-b5ac-1ebff341498d req-6d42aedb-b563-4ef3-b1ca-cf1089dce022 service nova] Releasing lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:46 user nova-compute[71500]: INFO nova.compute.manager [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Attaching volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d to /dev/vdb
Apr 14 16:08:46 user nova-compute[71500]: DEBUG os_brick.utils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[be252b24-e59a-4d7e-91cf-25d9c1272789]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36fa94-9631-4198-9c6b-eb72f5b4c86c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18ecc6a-d9b3-49dd-b8e4-c751b88b149e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b2bc25-361d-4ae8-916c-28169eec785c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:46 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:08:47 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:08:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e72f41-0a57-41e4-bbd4-8c8477bb1460]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG os_brick.utils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:08:47 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updating existing volume attachment record: d44344f9-cd21-4b43-bf7c-f6776258712f {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:08:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xioNSQWE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:08:54 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:08:54 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:08:54 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[966797ca-64fb-4fb7-8f0b-e3c3f03bc4c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:08:54 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[99084a97-e078-454d-8cc0-db333cc8b5dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d] added
Apr 14 16:08:54 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[756320ec-5f0c-4f50-9024-d640b56e061f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8208fc-8242-4769-aee7-6611dfc2d335]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xioNSQWE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xioNSQWE" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48cf291-7892-4ae7-9277-14362b8dac9e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xioNSQWE'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac24084-6d88-40b4-99a0-fb4c09c8337e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ecfb7e-4bb8-4cfe-9cfc-6ede29501afa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:08:54 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:08:54 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:08:54 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:08:54 user nova-compute[71500]: 
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c855b65e-28dc-40bd-a3d5-5997271ab33f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260]
Apr 14 16:08:54 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260] successful.
Apr 14 16:08:54 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.049s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e08e4-1de7-44cf-b147-37f67741f2dc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8615209-c080-444d-82d2-ffe2384de718]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d (non-flash)
Apr 14 16:08:54 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d (non-flash)
Apr 14 16:08:54 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3458604-f06d-41ab-849c-caddf38dcd16]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xioNSQWE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:55 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:08:55 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23661613964363531', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:08:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661613964363531', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:08:55 user nova-compute[71500]: DEBUG nova.objects.instance [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:08:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 16:08:55 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:08:55 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 16:08:55 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:08:55 user nova-compute[71500]:   <serial>cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d</serial>
Apr 14 16:08:55 user nova-compute[71500]: </disk>
Apr 14 16:08:55 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 16:08:55 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:08:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:08:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:e8:40:4d, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:08:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-edc7cada-1160-4050-bad1-89b06139405a tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.418s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:08:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:08:57 user nova-compute[71500]: INFO nova.compute.manager [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Detaching volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d
Apr 14 16:08:57 user nova-compute[71500]: INFO nova.virt.block_device [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Attempting to driver detach volume cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d from mountpoint /dev/vdb
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Attempting to detach device vdb from instance 971c41c2-4757-4a9c-bef7-aff8b6386611 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:08:57 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:08:57 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 16:08:57 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:08:57 user nova-compute[71500]:   <serial>cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d</serial>
Apr 14 16:08:57 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:08:57 user nova-compute[71500]: </disk>
Apr 14 16:08:57 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:08:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully detached device vdb from instance 971c41c2-4757-4a9c-bef7-aff8b6386611 from the persistent domain config.
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 971c41c2-4757-4a9c-bef7-aff8b6386611 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:08:57 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:08:57 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 16:08:57 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:08:57 user nova-compute[71500]:   <serial>cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d</serial>
Apr 14 16:08:57 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:08:57 user nova-compute[71500]: </disk>
Apr 14 16:08:57 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681488537.5136287, 971c41c2-4757-4a9c-bef7-aff8b6386611 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 16:08:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully detached device vdb from instance 971c41c2-4757-4a9c-bef7-aff8b6386611 from the live domain config.
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xioNSQWE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:08:57 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc78836-4f80-46fb-8035-610581f6e62e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:08:57 user nova-compute[71500]: No targets found.
Apr 14 16:08:57 user nova-compute[71500]: iSNS:
Apr 14 16:08:57 user nova-compute[71500]: No targets found.
Apr 14 16:08:57 user nova-compute[71500]: STATIC:
Apr 14 16:08:57 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d
Apr 14 16:08:57 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:08:57 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:08:57 user nova-compute[71500]: FIRMWARE:
Apr 14 16:08:57 user nova-compute[71500]: No targets found.
Apr 14 16:08:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:08:57 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:08:57 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[684bbf87-b4d5-469b-8051-100ac1c2925b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b825b0-a100-4be5-b4b8-489334e5005d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d (non-flash)
Apr 14 16:08:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d (non-flash)
Apr 14 16:08:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc61c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaa63db-82e6-4554-a05d-fc2ccfa0929e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b041bb53-7fb5-45f7-94f6-39c890e49bde]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[992ff8e4-4f9a-4c86-bf1a-e4b9a070e6dd]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22ad4ba-16fc-48fd-98d1-0a6b37102e00]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d0c7b6-9db9-41cc-8e2e-fe5c3bc30dcf]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc7e999-cdcd-477a-acd1-1dfeb5fee529]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260]
Apr 14 16:08:57 user nova-compute[71500]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d, portal: 172.16.0.220,3260] successful.
Apr 14 16:08:57 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb85bafe-54ac-4d5e-8d97-bf07f59b2f7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[736b32c6-b9dc-4ca7-838b-8751d5445488]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== disconnect_volume: return (289ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:08:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c76389bb-23bc-429a-8ab9-faea3f66e5f2 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.651s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updating instance_info_cache with network_info: [{"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-971c41c2-4757-4a9c-bef7-aff8b6386611" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:08:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:08:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:08:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:00 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:09:00 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=26.12881088256836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 971c41c2-4757-4a9c-bef7-aff8b6386611 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:09:00 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:09:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:09:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:04 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:09:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:09:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:09:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:18 user nova-compute[71500]: INFO nova.compute.manager [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Unshelving
Apr 14 16:09:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'pci_requests' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG nova.objects.instance [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'numa_topology' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:09:18 user nova-compute[71500]: INFO nova.compute.claims [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Claim successful on node user
Apr 14 16:09:18 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:09:18 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:18 user nova-compute[71500]: INFO nova.network.neutron [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing instance network info cache due to event network-changed-4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:09:19 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Creating image(s)
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'trusted_certs' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG nova.network.neutron [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Refreshing network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "4991d1389101f4e1ff470fb320454ab45cd9f278" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "4991d1389101f4e1ff470fb320454ab45cd9f278" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.part --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.part --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:20 user nova-compute[71500]: DEBUG nova.virt.images [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] 51eb1050-a60f-4548-b6cf-81ffbcf2e3bc was qcow2, converting to raw {{(pid=71500) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 16:09:20 user nova-compute[71500]: DEBUG nova.privsep.utils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71500) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 16:09:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.part /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.converted {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG nova.network.neutron [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated VIF entry in instance network info cache for port 4fb1ed9f-cabd-454e-b69b-96869e3bdc38. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG nova.network.neutron [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.part /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.converted" returned: 0 in 0.363s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.converted --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9e8b22a7-e31f-4ab2-a0ab-0825216c3151 req-f9cd12cc-87a3-48f3-96d0-187115b0ee24 service nova] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "4991d1389101f4e1ff470fb320454ab45cd9f278" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.362s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278 --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "4991d1389101f4e1ff470fb320454ab45cd9f278" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "4991d1389101f4e1ff470fb320454ab45cd9f278" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278 --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278,backing_fmt=raw /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278,backing_fmt=raw /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk 1073741824" returned: 0 in 0.060s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "4991d1389101f4e1ff470fb320454ab45cd9f278" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'migration_context' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Rebasing disk image.
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 -F raw /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 -F raw /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk" returned: 0 in 2.022s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Ensure instance console log exists: /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Start _get_guest_xml network_info=[{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8d8ac484e33b2063dedc514754fc87a8',container_format='bare',created_at=2023-04-14T16:07:25Z,direct_url=<?>,disk_format='qcow2',id=51eb1050-a60f-4548-b6cf-81ffbcf2e3bc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-124723558-shelved',owner='b0dd8e5513a94cc8b22c291bac3b066f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T16:07:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:09:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:09:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8d8ac484e33b2063dedc514754fc87a8',container_format='bare',created_at=2023-04-14T16:07:25Z,direct_url=<?>,disk_format='qcow2',id=51eb1050-a60f-4548-b6cf-81ffbcf2e3bc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-124723558-shelved',owner='b0dd8e5513a94cc8b22c291bac3b066f',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T16:07:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:09:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T16:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-124723558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-124723558',id=34,image_ref='51eb1050-a60f-4548-b6cf-81ffbcf2e3bc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-564331105',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:05:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-mb4paot8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member',shelved_at='2023-04-14T16:07:29.092867',shelved_host='user',shelved_image_id='51eb1050-a60f-4548-b6cf-81ffbcf2e3bc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:09:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=89cb156f-a586-4206-b995-999ebca99f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'pci_devices' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:09:24 user nova-compute[71500]:   <uuid>89cb156f-a586-4206-b995-999ebca99f38</uuid>
Apr 14 16:09:24 user nova-compute[71500]:   <name>instance-00000022</name>
Apr 14 16:09:24 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:09:24 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:09:24 user nova-compute[71500]:   <metadata>
Apr 14 16:09:24 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:09:24 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:09:24 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-124723558</nova:name>
Apr 14 16:09:24 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:09:23</nova:creationTime>
Apr 14 16:09:24 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:09:24 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:09:24 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:09:24 user nova-compute[71500]:       <nova:owner>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:user uuid="194adad706f94ef89a86fbcb9d8888ac">tempest-AttachVolumeShelveTestJSON-1653640190-project-member</nova:user>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:project uuid="b0dd8e5513a94cc8b22c291bac3b066f">tempest-AttachVolumeShelveTestJSON-1653640190</nova:project>
Apr 14 16:09:24 user nova-compute[71500]:       </nova:owner>
Apr 14 16:09:24 user nova-compute[71500]:       <nova:root type="image" uuid="51eb1050-a60f-4548-b6cf-81ffbcf2e3bc"/>
Apr 14 16:09:24 user nova-compute[71500]:       <nova:ports>
Apr 14 16:09:24 user nova-compute[71500]:         <nova:port uuid="4fb1ed9f-cabd-454e-b69b-96869e3bdc38">
Apr 14 16:09:24 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 16:09:24 user nova-compute[71500]:         </nova:port>
Apr 14 16:09:24 user nova-compute[71500]:       </nova:ports>
Apr 14 16:09:24 user nova-compute[71500]:     </nova:instance>
Apr 14 16:09:24 user nova-compute[71500]:   </metadata>
Apr 14 16:09:24 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:09:24 user nova-compute[71500]:     <system>
Apr 14 16:09:24 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:09:24 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:09:24 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:09:24 user nova-compute[71500]:       <entry name="serial">89cb156f-a586-4206-b995-999ebca99f38</entry>
Apr 14 16:09:24 user nova-compute[71500]:       <entry name="uuid">89cb156f-a586-4206-b995-999ebca99f38</entry>
Apr 14 16:09:24 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:09:24 user nova-compute[71500]:     </system>
Apr 14 16:09:24 user nova-compute[71500]:   </sysinfo>
Apr 14 16:09:24 user nova-compute[71500]:   <os>
Apr 14 16:09:24 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:09:24 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:09:24 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:09:24 user nova-compute[71500]:   </os>
Apr 14 16:09:24 user nova-compute[71500]:   <features>
Apr 14 16:09:24 user nova-compute[71500]:     <acpi/>
Apr 14 16:09:24 user nova-compute[71500]:     <apic/>
Apr 14 16:09:24 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:09:24 user nova-compute[71500]:   </features>
Apr 14 16:09:24 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:09:24 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:09:24 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:09:24 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:09:24 user nova-compute[71500]:   </clock>
Apr 14 16:09:24 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:09:24 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:09:24 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:09:24 user nova-compute[71500]:   </cpu>
Apr 14 16:09:24 user nova-compute[71500]:   <devices>
Apr 14 16:09:24 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:09:24 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:09:24 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk"/>
Apr 14 16:09:24 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:09:24 user nova-compute[71500]:     </disk>
Apr 14 16:09:24 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:09:24 user nova-compute[71500]:       <mac address="fa:16:3e:14:95:05"/>
Apr 14 16:09:24 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:09:24 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:09:24 user nova-compute[71500]:       <target dev="tap4fb1ed9f-ca"/>
Apr 14 16:09:24 user nova-compute[71500]:     </interface>
Apr 14 16:09:24 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:09:24 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/console.log" append="off"/>
Apr 14 16:09:24 user nova-compute[71500]:     </serial>
Apr 14 16:09:24 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:09:24 user nova-compute[71500]:     <video>
Apr 14 16:09:24 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:09:24 user nova-compute[71500]:     </video>
Apr 14 16:09:24 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:09:24 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:09:24 user nova-compute[71500]:     </rng>
Apr 14 16:09:24 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:09:24 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:09:24 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:09:24 user nova-compute[71500]:     </memballoon>
Apr 14 16:09:24 user nova-compute[71500]:   </devices>
Apr 14 16:09:24 user nova-compute[71500]: </domain>
Apr 14 16:09:24 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T16:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-124723558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-124723558',id=34,image_ref='51eb1050-a60f-4548-b6cf-81ffbcf2e3bc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-564331105',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:05:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-mb4paot8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member',shelved_at='2023-04-14T16:07:29.092867',shelved_host='user',shelved_image_id='51eb1050-a60f-4548-b6cf-81ffbcf2e3bc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:09:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=89cb156f-a586-4206-b995-999ebca99f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG os_vif [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb1ed9f-ca, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4fb1ed9f-ca, col_values=(('external_ids', {'iface-id': '4fb1ed9f-cabd-454e-b69b-96869e3bdc38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:95:05', 'vm-uuid': '89cb156f-a586-4206-b995-999ebca99f38'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:24 user nova-compute[71500]: INFO os_vif [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca')
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:09:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] No VIF found with MAC fa:16:3e:14:95:05, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:09:25 user nova-compute[71500]: WARNING nova.compute.manager [req-df8511c3-bbac-463b-a56a-323be73c2be8 req-e26a5b81-73d0-464a-ade8-eb17996122aa service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 16:09:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488567.8021657, 89cb156f-a586-4206-b995-999ebca99f38 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:09:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] VM Resumed (Lifecycle Event)
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:09:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance spawned successfully.
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:09:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488567.806328, 89cb156f-a586-4206-b995-999ebca99f38 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:09:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] VM Started (Lifecycle Event)
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:09:27 user nova-compute[71500]: WARNING nova.compute.manager [req-61e7f9b9-0c94-45f5-91fd-dcf9048c4bfe req-513853e6-db4f-420b-ae03-17df804684dc service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:09:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:09:27 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:09:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:09:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-45481dec-7874-496c-ab0d-2adb86606f1f tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.092s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:09:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:09:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:09:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:47 user nova-compute[71500]: INFO nova.compute.manager [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Terminating instance
Apr 14 16:09:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-vif-unplugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] No waiting events found dispatching network-vif-unplugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:09:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-a4207bb4-0868-4862-bbc5-7cb5dad72427 req-fdf0a8fc-9a5f-4010-b296-b920ce19bebe service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-vif-unplugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:09:48 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Instance destroyed successfully.
Apr 14 16:09:48 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'resources' on Instance uuid 971c41c2-4757-4a9c-bef7-aff8b6386611 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:06:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-968788151',display_name='tempest-AttachVolumeNegativeTest-server-968788151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-968788151',id=36,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdQGyEZxcMTFif2Fb0VzDaFXGQPiXG8GLAWmvhsMb1cuzmisMXAkf9eWnBOu3OuqWPsVR66YcTHn/BD+yPOOCjhzbuxyiGr8oalwYLWVgmWBAGVr6EoWbycD+FNaOa84A==',key_name='tempest-keypair-388847104',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:06:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-u1cm2yto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=971c41c2-4757-4a9c-bef7-aff8b6386611,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "address": "fa:16:3e:e8:40:4d", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f4a46b-0c", "ovs_interfaceid": "36f4a46b-0cb2-4a15-b995-43b84aa8d86a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG os_vif [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f4a46b-0c, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:09:48 user nova-compute[71500]: INFO os_vif [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:40:4d,bridge_name='br-int',has_traffic_filtering=True,id=36f4a46b-0cb2-4a15-b995-43b84aa8d86a,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f4a46b-0c')
Apr 14 16:09:48 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Deleting instance files /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611_del
Apr 14 16:09:48 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Deletion of /opt/stack/data/nova/instances/971c41c2-4757-4a9c-bef7-aff8b6386611_del complete
Apr 14 16:09:48 user nova-compute[71500]: INFO nova.compute.manager [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 16:09:48 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:09:48 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:09:49 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Took 1.01 seconds to deallocate network for instance.
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:49 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Deleted allocations for instance 971c41c2-4757-4a9c-bef7-aff8b6386611
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9c54d247-ec9f-4ebc-8870-3181f73aaa7e tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Acquiring lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] Lock "971c41c2-4757-4a9c-bef7-aff8b6386611-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] No waiting events found dispatching network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:09:49 user nova-compute[71500]: WARNING nova.compute.manager [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received unexpected event network-vif-plugged-36f4a46b-0cb2-4a15-b995-43b84aa8d86a for instance with vm_state deleted and task_state None.
Apr 14 16:09:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-237af88f-6e5c-4cf9-ba82-bf8fb2ae9472 req-074d319b-86ab-4632-a761-076f256bf603 service nova] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Received event network-vif-deleted-36f4a46b-0cb2-4a15-b995-43b84aa8d86a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:09:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:57 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:09:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:09:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:01 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:10:01 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=26.130043029785156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 89cb156f-a586-4206-b995-999ebca99f38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:10:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:03 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488588.1350203, 971c41c2-4757-4a9c-bef7-aff8b6386611 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:10:03 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] VM Stopped (Lifecycle Event)
Apr 14 16:10:03 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5bbed97b-b290-4457-bd76-0f454bef8eff None None] [instance: 971c41c2-4757-4a9c-bef7-aff8b6386611] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:14 user nova-compute[71500]: INFO nova.compute.manager [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Unshelving
Apr 14 16:10:14 user nova-compute[71500]: INFO nova.virt.block_device [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Booting with volume 2947891b-11ba-4dc1-9435-83fe187e0f04 at /dev/vda
Apr 14 16:10:14 user nova-compute[71500]: DEBUG os_brick.utils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e5d910-954d-4986-8de3-80125fb3fe54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a518173-6d78-401e-9ac8-5f86e4f7a1bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[755a11d0-a1c3-4fb3-8881-ed5793d4f846]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c8040b-c566-4b7f-aed4-bcf43b19910d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:10:14 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:10:14 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c7aba1-58cc-43ac-a7a5-d9fcd9b0c954]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG os_brick.utils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating existing volume attachment record: 61567e78-98eb-4f54-ad3f-52b27c942b07 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:10:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'pci_requests' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:10:19 user nova-compute[71500]: INFO nova.compute.claims [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Claim successful on node user
Apr 14 16:10:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:10:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:19 user nova-compute[71500]: INFO nova.network.neutron [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating port f572c852-fb5c-4ceb-aac4-4be593331f83 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing instance network info cache due to event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:10:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Creating image(s)
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Ensure instance console log exists: /opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Start _get_guest_xml network_info=[{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '61567e78-98eb-4f54-ad3f-52b27c942b07', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fbd3667-302e-4f1f-8e58-2bdabe5efe57', 'attached_at': '', 'detached_at': '', 'volume_id': '2947891b-11ba-4dc1-9435-83fe187e0f04', 'serial': '2947891b-11ba-4dc1-9435-83fe187e0f04'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:10:20 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:10:20 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:10:20 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:10:20 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:10:20 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db98db-193e-4c8b-988c-06059ecc3fa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:10:20 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[144794d9-8f18-4b08-97e3-4ea0f3e069de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04] added
Apr 14 16:10:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7044ac2d-7880-48e8-88fc-6c7d5cf94a51]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19bd96e-561d-4716-8e07-9baa8edc438e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVWPZEQX {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVWPZEQX" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[431bbb63-67c3-477e-a365-bb462af18048]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVWPZEQX'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b3c6d6-88c3-4866-af9f-dc2b7c12100a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6520f502-d724-445b-83f2-5536d374d6d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:10:20 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:10:20 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:10:20 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:10:20 user nova-compute[71500]: 
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435cb62-9d75-417e-8140-69416edb28ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]
Apr 14 16:10:20 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.
Apr 14 16:10:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e5d7b2-1d6f-4b7a-8681-7cc34cc8ede1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28c53c-e298-4b96-b12d-6304ec0a1d39]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:10:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:10:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d4df5-6281-4fd6-8255-ad3fa5ab0c6b]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated VIF entry in instance network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:10:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2effd65-7e7b-4c18-bd68-acd2e6b5cf83 req-42ff5a2c-50fb-4d23-b501-04d3575d7dc0 service nova] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23361326138343830', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361326138343830', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T16:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-491913355',display_name='tempest-TestShelveInstance-server-491913355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-491913355',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-163308382',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0f145f9471aa46ab88e93a9d4c7a4535',ramdisk_id='',reservation_id='r-s61xjs93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1830025798',owner_user_name='tempest-TestShelveInstance-1830025798-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:10:14Z,user_data=None,user_id='ca751b25580040a2b48039142c91d58f',uuid=8fbd3667-302e-4f1f-8e58-2bdabe5efe57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converting VIF {"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:10:21 user nova-compute[71500]:   <uuid>8fbd3667-302e-4f1f-8e58-2bdabe5efe57</uuid>
Apr 14 16:10:21 user nova-compute[71500]:   <name>instance-00000023</name>
Apr 14 16:10:21 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:10:21 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:10:21 user nova-compute[71500]:   <metadata>
Apr 14 16:10:21 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:10:21 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:10:21 user nova-compute[71500]:       <nova:name>tempest-TestShelveInstance-server-491913355</nova:name>
Apr 14 16:10:21 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:10:20</nova:creationTime>
Apr 14 16:10:21 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:10:21 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:10:21 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:10:21 user nova-compute[71500]:       <nova:owner>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:user uuid="ca751b25580040a2b48039142c91d58f">tempest-TestShelveInstance-1830025798-project-member</nova:user>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:project uuid="0f145f9471aa46ab88e93a9d4c7a4535">tempest-TestShelveInstance-1830025798</nova:project>
Apr 14 16:10:21 user nova-compute[71500]:       </nova:owner>
Apr 14 16:10:21 user nova-compute[71500]:       <nova:ports>
Apr 14 16:10:21 user nova-compute[71500]:         <nova:port uuid="f572c852-fb5c-4ceb-aac4-4be593331f83">
Apr 14 16:10:21 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 16:10:21 user nova-compute[71500]:         </nova:port>
Apr 14 16:10:21 user nova-compute[71500]:       </nova:ports>
Apr 14 16:10:21 user nova-compute[71500]:     </nova:instance>
Apr 14 16:10:21 user nova-compute[71500]:   </metadata>
Apr 14 16:10:21 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:10:21 user nova-compute[71500]:     <system>
Apr 14 16:10:21 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:10:21 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:10:21 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:10:21 user nova-compute[71500]:       <entry name="serial">8fbd3667-302e-4f1f-8e58-2bdabe5efe57</entry>
Apr 14 16:10:21 user nova-compute[71500]:       <entry name="uuid">8fbd3667-302e-4f1f-8e58-2bdabe5efe57</entry>
Apr 14 16:10:21 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:10:21 user nova-compute[71500]:     </system>
Apr 14 16:10:21 user nova-compute[71500]:   </sysinfo>
Apr 14 16:10:21 user nova-compute[71500]:   <os>
Apr 14 16:10:21 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:10:21 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:10:21 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:10:21 user nova-compute[71500]:   </os>
Apr 14 16:10:21 user nova-compute[71500]:   <features>
Apr 14 16:10:21 user nova-compute[71500]:     <acpi/>
Apr 14 16:10:21 user nova-compute[71500]:     <apic/>
Apr 14 16:10:21 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:10:21 user nova-compute[71500]:   </features>
Apr 14 16:10:21 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:10:21 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:10:21 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:10:21 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:10:21 user nova-compute[71500]:   </clock>
Apr 14 16:10:21 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:10:21 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:10:21 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:10:21 user nova-compute[71500]:   </cpu>
Apr 14 16:10:21 user nova-compute[71500]:   <devices>
Apr 14 16:10:21 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:10:21 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:10:21 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 16:10:21 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:10:21 user nova-compute[71500]:       <serial>2947891b-11ba-4dc1-9435-83fe187e0f04</serial>
Apr 14 16:10:21 user nova-compute[71500]:     </disk>
Apr 14 16:10:21 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:10:21 user nova-compute[71500]:       <mac address="fa:16:3e:60:38:4e"/>
Apr 14 16:10:21 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:10:21 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:10:21 user nova-compute[71500]:       <target dev="tapf572c852-fb"/>
Apr 14 16:10:21 user nova-compute[71500]:     </interface>
Apr 14 16:10:21 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:10:21 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57/console.log" append="off"/>
Apr 14 16:10:21 user nova-compute[71500]:     </serial>
Apr 14 16:10:21 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:10:21 user nova-compute[71500]:     <video>
Apr 14 16:10:21 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:10:21 user nova-compute[71500]:     </video>
Apr 14 16:10:21 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:10:21 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:10:21 user nova-compute[71500]:     </rng>
Apr 14 16:10:21 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:10:21 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:10:21 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:10:21 user nova-compute[71500]:     </memballoon>
Apr 14 16:10:21 user nova-compute[71500]:   </devices>
Apr 14 16:10:21 user nova-compute[71500]: </domain>
Apr 14 16:10:21 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T16:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-491913355',display_name='tempest-TestShelveInstance-server-491913355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-491913355',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-163308382',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:06:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0f145f9471aa46ab88e93a9d4c7a4535',ramdisk_id='',reservation_id='r-s61xjs93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1830025798',owner_user_name='tempest-TestShelveInstance-1830025798-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:10:14Z,user_data=None,user_id='ca751b25580040a2b48039142c91d58f',uuid=8fbd3667-302e-4f1f-8e58-2bdabe5efe57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converting VIF {"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG os_vif [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf572c852-fb, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf572c852-fb, col_values=(('external_ids', {'iface-id': 'f572c852-fb5c-4ceb-aac4-4be593331f83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:38:4e', 'vm-uuid': '8fbd3667-302e-4f1f-8e58-2bdabe5efe57'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:21 user nova-compute[71500]: INFO os_vif [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb')
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:10:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] No VIF found with MAC fa:16:3e:60:38:4e, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:10:23 user nova-compute[71500]: WARNING nova.compute.manager [req-27c16bad-ddf7-4959-b29a-6684f4d30dbc req-3987a3b5-dfb3-4cf5-bff9-4f482a2bf99f service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488625.3319316, 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:10:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] VM Resumed (Lifecycle Event)
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:10:25 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance spawned successfully.
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:10:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488625.3374863, 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:10:25 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] VM Started (Lifecycle Event)
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad0428a7-e5c0-42a0-8c2c-43bf03811f93 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.211s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:10:25 user nova-compute[71500]: WARNING nova.compute.manager [req-d6925845-8ed7-430b-b221-67d223c2fcd6 req-800a4c05-2991-4d6e-b9f6-304365f204ab service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state None.
Apr 14 16:10:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:10:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:10:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:10:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:10:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:10:41 user nova-compute[71500]: INFO nova.compute.claims [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Claim successful on node user
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:10:41 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.policy [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d83796cd8d5464fa4e580844441da81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecb4d204dbf24c19b978456d16d19e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:10:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:10:42 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Creating image(s)
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "/opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.178s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk 1073741824" returned: 0 in 0.050s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.156s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Cannot resize image /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG nova.objects.instance [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'migration_context' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Ensure instance console log exists: /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:42 user nova-compute[71500]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Successfully created port: a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Successfully updated port: a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquired lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-changed-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.compute.manager [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Refreshing instance network info cache due to event network-changed-a088891b-f698-4783-8b4d-caacf03d3747. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Acquiring lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.neutron [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updating instance_info_cache with network_info: [{"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Releasing lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Instance network_info: |[{"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Acquired lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.neutron [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Refreshing network info cache for port a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Start _get_guest_xml network_info=[{"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:10:43 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:10:43 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2085721900',display_name='tempest-AttachVolumeNegativeTest-server-2085721900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2085721900',id=37,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMies72o3CTJZcRAOo1f/8fx+L36gTla/KTevmmTBxnCOJ4l2fhCY8Lh+4u86skeMnTKY3SGVCASxcYOcS2vN2SDP9c5xB/Mx9DXTuFAMVvifMjJD8BK8/dZ0BuqCqyVpw==',key_name='tempest-keypair-2020858187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-tsaf907b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=f1963f30-fea7-49f0-aa6d-5df33a362258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.objects.instance [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'pci_devices' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:10:43 user nova-compute[71500]:   <uuid>f1963f30-fea7-49f0-aa6d-5df33a362258</uuid>
Apr 14 16:10:43 user nova-compute[71500]:   <name>instance-00000025</name>
Apr 14 16:10:43 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:10:43 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:10:43 user nova-compute[71500]:   <metadata>
Apr 14 16:10:43 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:10:43 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:10:43 user nova-compute[71500]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2085721900</nova:name>
Apr 14 16:10:43 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:10:43</nova:creationTime>
Apr 14 16:10:43 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:10:43 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:10:43 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:10:43 user nova-compute[71500]:       <nova:owner>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:user uuid="2d83796cd8d5464fa4e580844441da81">tempest-AttachVolumeNegativeTest-378331452-project-member</nova:user>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:project uuid="ecb4d204dbf24c19b978456d16d19e87">tempest-AttachVolumeNegativeTest-378331452</nova:project>
Apr 14 16:10:43 user nova-compute[71500]:       </nova:owner>
Apr 14 16:10:43 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:10:43 user nova-compute[71500]:       <nova:ports>
Apr 14 16:10:43 user nova-compute[71500]:         <nova:port uuid="a088891b-f698-4783-8b4d-caacf03d3747">
Apr 14 16:10:43 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 16:10:43 user nova-compute[71500]:         </nova:port>
Apr 14 16:10:43 user nova-compute[71500]:       </nova:ports>
Apr 14 16:10:43 user nova-compute[71500]:     </nova:instance>
Apr 14 16:10:43 user nova-compute[71500]:   </metadata>
Apr 14 16:10:43 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:10:43 user nova-compute[71500]:     <system>
Apr 14 16:10:43 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:10:43 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:10:43 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:10:43 user nova-compute[71500]:       <entry name="serial">f1963f30-fea7-49f0-aa6d-5df33a362258</entry>
Apr 14 16:10:43 user nova-compute[71500]:       <entry name="uuid">f1963f30-fea7-49f0-aa6d-5df33a362258</entry>
Apr 14 16:10:43 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:10:43 user nova-compute[71500]:     </system>
Apr 14 16:10:43 user nova-compute[71500]:   </sysinfo>
Apr 14 16:10:43 user nova-compute[71500]:   <os>
Apr 14 16:10:43 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:10:43 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:10:43 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:10:43 user nova-compute[71500]:   </os>
Apr 14 16:10:43 user nova-compute[71500]:   <features>
Apr 14 16:10:43 user nova-compute[71500]:     <acpi/>
Apr 14 16:10:43 user nova-compute[71500]:     <apic/>
Apr 14 16:10:43 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:10:43 user nova-compute[71500]:   </features>
Apr 14 16:10:43 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:10:43 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:10:43 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:10:43 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:10:43 user nova-compute[71500]:   </clock>
Apr 14 16:10:43 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:10:43 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:10:43 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:10:43 user nova-compute[71500]:   </cpu>
Apr 14 16:10:43 user nova-compute[71500]:   <devices>
Apr 14 16:10:43 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:10:43 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:10:43 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk"/>
Apr 14 16:10:43 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:10:43 user nova-compute[71500]:     </disk>
Apr 14 16:10:43 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:10:43 user nova-compute[71500]:       <mac address="fa:16:3e:c4:7b:d3"/>
Apr 14 16:10:43 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:10:43 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:10:43 user nova-compute[71500]:       <target dev="tapa088891b-f6"/>
Apr 14 16:10:43 user nova-compute[71500]:     </interface>
Apr 14 16:10:43 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:10:43 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/console.log" append="off"/>
Apr 14 16:10:43 user nova-compute[71500]:     </serial>
Apr 14 16:10:43 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:10:43 user nova-compute[71500]:     <video>
Apr 14 16:10:43 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:10:43 user nova-compute[71500]:     </video>
Apr 14 16:10:43 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:10:43 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:10:43 user nova-compute[71500]:     </rng>
Apr 14 16:10:43 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:10:43 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:10:43 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:10:43 user nova-compute[71500]:     </memballoon>
Apr 14 16:10:43 user nova-compute[71500]:   </devices>
Apr 14 16:10:43 user nova-compute[71500]: </domain>
Apr 14 16:10:43 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2085721900',display_name='tempest-AttachVolumeNegativeTest-server-2085721900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2085721900',id=37,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMies72o3CTJZcRAOo1f/8fx+L36gTla/KTevmmTBxnCOJ4l2fhCY8Lh+4u86skeMnTKY3SGVCASxcYOcS2vN2SDP9c5xB/Mx9DXTuFAMVvifMjJD8BK8/dZ0BuqCqyVpw==',key_name='tempest-keypair-2020858187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-tsaf907b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=f1963f30-fea7-49f0-aa6d-5df33a362258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG os_vif [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa088891b-f6, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa088891b-f6, col_values=(('external_ids', {'iface-id': 'a088891b-f698-4783-8b4d-caacf03d3747', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:7b:d3', 'vm-uuid': 'f1963f30-fea7-49f0-aa6d-5df33a362258'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:10:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:43 user nova-compute[71500]: INFO os_vif [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6')
Apr 14 16:10:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:10:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:c4:7b:d3, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:10:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updated VIF entry in instance network info cache for port a088891b-f698-4783-8b4d-caacf03d3747. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:10:44 user nova-compute[71500]: DEBUG nova.network.neutron [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updating instance_info_cache with network_info: [{"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:10:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5c9ee7fe-d5c7-44ac-b459-a114d7780e33 req-5236357d-ce90-4b09-980c-b1f7170cdaee service nova] Releasing lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:10:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] No waiting events found dispatching network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:10:45 user nova-compute[71500]: WARNING nova.compute.manager [req-6048f4e9-c543-4524-850e-1cc302c54f7b req-5fd021ee-4112-4027-bce6-cdbad7f5656a service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received unexpected event network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 for instance with vm_state building and task_state spawning.
Apr 14 16:10:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488647.4454021, f1963f30-fea7-49f0-aa6d-5df33a362258 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] VM Resumed (Lifecycle Event)
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Instance spawned successfully.
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488647.4484715, f1963f30-fea7-49f0-aa6d-5df33a362258 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] VM Started (Lifecycle Event)
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Took 5.56 seconds to spawn the instance on the hypervisor.
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:47 user nova-compute[71500]: DEBUG nova.compute.manager [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] No waiting events found dispatching network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:10:47 user nova-compute[71500]: WARNING nova.compute.manager [req-9cc025d1-b7d8-4097-be6c-ae596391a813 req-d16d5bcf-873c-4c42-a7ed-cbf7ef322b87 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received unexpected event network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 for instance with vm_state building and task_state spawning.
Apr 14 16:10:47 user nova-compute[71500]: INFO nova.compute.manager [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Took 6.19 seconds to build instance.
Apr 14 16:10:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-87b7a4b8-e791-4afd-b92b-5014e2bbd471 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.286s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:10:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:56 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:57 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:58 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:10:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [{"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-89cb156f-a586-4206-b995-999ebca99f38" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:10:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:11:01 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:11:02 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:11:02 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=26.108901977539062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 89cb156f-a586-4206-b995-999ebca99f38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f1963f30-fea7-49f0-aa6d-5df33a362258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:11:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:11:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:08 user nova-compute[71500]: INFO nova.compute.manager [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Terminating instance
Apr 14 16:11:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-unplugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-unplugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-58da2aa5-9013-48bc-ba9d-b378f5b4f570 req-5897ac09-a538-4e39-8991-a199a08b19e3 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-unplugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:11:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Instance destroyed successfully.
Apr 14 16:11:09 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lazy-loading 'resources' on Instance uuid 89cb156f-a586-4206-b995-999ebca99f38 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T16:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-124723558',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-124723558',id=34,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNipUVm/SMGITJ/VqIfLO974eqF4qj5uNHbX8svN0zvFZEcFu4uU1z2c8JUk1b8hdRDZntipAlsBEvp03UjR31lBoZlbhXKRg4gjqurx76SHqLWPJwkwrDAXvR7xo0zLAQ==',key_name='tempest-keypair-564331105',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0dd8e5513a94cc8b22c291bac3b066f',ramdisk_id='',reservation_id='r-mb4paot8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1653640190',owner_user_name='tempest-AttachVolumeShelveTestJSON-1653640190-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='194adad706f94ef89a86fbcb9d8888ac',uuid=89cb156f-a586-4206-b995-999ebca99f38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converting VIF {"id": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "address": "fa:16:3e:14:95:05", "network": {"id": "02907ca9-ef91-415d-916b-dcf4c9134b49", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1565339662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0dd8e5513a94cc8b22c291bac3b066f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb1ed9f-ca", "ovs_interfaceid": "4fb1ed9f-cabd-454e-b69b-96869e3bdc38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG os_vif [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb1ed9f-ca, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:11:09 user nova-compute[71500]: INFO os_vif [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:95:05,bridge_name='br-int',has_traffic_filtering=True,id=4fb1ed9f-cabd-454e-b69b-96869e3bdc38,network=Network(02907ca9-ef91-415d-916b-dcf4c9134b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb1ed9f-ca')
Apr 14 16:11:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Deleting instance files /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38_del
Apr 14 16:11:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Deletion of /opt/stack/data/nova/instances/89cb156f-a586-4206-b995-999ebca99f38_del complete
Apr 14 16:11:09 user nova-compute[71500]: INFO nova.compute.manager [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 16:11:09 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:11:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:11:10 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Took 1.08 seconds to deallocate network for instance.
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:10 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Deleted allocations for instance 89cb156f-a586-4206-b995-999ebca99f38
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6db83f79-72a1-4657-9617-b4040f704d13 tempest-AttachVolumeShelveTestJSON-1653640190 tempest-AttachVolumeShelveTestJSON-1653640190-project-member] Lock "89cb156f-a586-4206-b995-999ebca99f38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Acquiring lock "89cb156f-a586-4206-b995-999ebca99f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] Lock "89cb156f-a586-4206-b995-999ebca99f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] No waiting events found dispatching network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:11:10 user nova-compute[71500]: WARNING nova.compute.manager [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received unexpected event network-vif-plugged-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 for instance with vm_state deleted and task_state None.
Apr 14 16:11:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-0b53eb8d-729d-465f-8eda-500c6c9fddfd req-d1d78ef4-883b-4c82-9446-faa03ac2c8c1 service nova] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Received event network-vif-deleted-4fb1ed9f-cabd-454e-b69b-96869e3bdc38 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:11:10 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:24 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488669.0548677, 89cb156f-a586-4206-b995-999ebca99f38 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:11:24 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 89cb156f-a586-4206-b995-999ebca99f38] VM Stopped (Lifecycle Event)
Apr 14 16:11:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-5ff2c543-c417-4d59-a52a-4e6fe8f5c130 None None] [instance: 89cb156f-a586-4206-b995-999ebca99f38] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:11:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:11:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:11:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:11:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:11:58 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:11:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:00 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:12:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:02 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:12:02 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:12:02 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=26.118534088134766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f1963f30-fea7-49f0-aa6d-5df33a362258 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:12:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:12:04 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG nova.compute.manager [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing instance network info cache due to event network-changed-f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Acquiring lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Acquired lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG nova.network.neutron [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Refreshing network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:05 user nova-compute[71500]: INFO nova.compute.manager [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Terminating instance
Apr 14 16:12:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.network.neutron [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updated VIF entry in instance network info cache for port f572c852-fb5c-4ceb-aac4-4be593331f83. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.network.neutron [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [{"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0aec18e7-6684-41ea-8261-eb2cb06d5407 req-3487ed7a-8124-404e-9176-2308dba6dd45 service nova] Releasing lock "refresh_cache-8fbd3667-302e-4f1f-8e58-2bdabe5efe57" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:12:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Instance destroyed successfully.
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lazy-loading 'resources' on Instance uuid 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T16:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-491913355',display_name='tempest-TestShelveInstance-server-491913355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-491913355',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIVqE9fEVycFAK+Gh/+LweMpamRDIGnhFfG42+5HdOWX1XdC8hGLSoifG92sxHHVA8mRsvZgr42YuaW4sLfHJ80/IMh3TNaLl+E7j32V5F75cszy3PrR7bTxzkPUUbDYg==',key_name='tempest-TestShelveInstance-163308382',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:10:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f145f9471aa46ab88e93a9d4c7a4535',ramdisk_id='',reservation_id='r-s61xjs93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1830025798',owner_user_name='tempest-TestShelveInstance-1830025798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:10:25Z,user_data=None,user_id='ca751b25580040a2b48039142c91d58f',uuid=8fbd3667-302e-4f1f-8e58-2bdabe5efe57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converting VIF {"id": "f572c852-fb5c-4ceb-aac4-4be593331f83", "address": "fa:16:3e:60:38:4e", "network": {"id": "1638ee72-d25e-4900-bfa3-d13dee7504d6", "bridge": "br-int", "label": "tempest-TestShelveInstance-644959905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f145f9471aa46ab88e93a9d4c7a4535", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf572c852-fb", "ovs_interfaceid": "f572c852-fb5c-4ceb-aac4-4be593331f83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_vif [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf572c852-fb, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:12:06 user nova-compute[71500]: INFO os_vif [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=f572c852-fb5c-4ceb-aac4-4be593331f83,network=Network(1638ee72-d25e-4900-bfa3-d13dee7504d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf572c852-fb')
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWPZEQX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:12:06 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2211014-64e7-43aa-b873-8540f11e6044]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:12:06 user nova-compute[71500]: No targets found.
Apr 14 16:12:06 user nova-compute[71500]: iSNS:
Apr 14 16:12:06 user nova-compute[71500]: No targets found.
Apr 14 16:12:06 user nova-compute[71500]: STATIC:
Apr 14 16:12:06 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04
Apr 14 16:12:06 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:12:06 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:12:06 user nova-compute[71500]: FIRMWARE:
Apr 14 16:12:06 user nova-compute[71500]: No targets found.
Apr 14 16:12:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:12:06 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:12:06 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd76aa3-1ec9-482d-b708-da3f3ebe4cac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3e185-8fe2-42b3-b655-2c8cba4f6450]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:12:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 (non-flash)
Apr 14 16:12:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae020c63b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d73f1d-8727-4455-8ac5-e686e198fe7b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6a97c-b699-41b2-ba0e-77281ae89094]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef54b7a-2db4-4299-9c47-fdede39ec955]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0223ec3e-d830-4982-be0c-f206753ca4f1]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa28f9ad9-3a2a8480d94e2e2d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a28f9ad9', '/dev/disk/by-id/scsi-23361326138343830') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37cc7b3-6303-49f4-804c-4050dd75f3cf]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4276a4a9-17be-4606-b716-d9e221234f4b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[11130cb5-d850-41c9-b960-2d4fc49b9ba0]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260]
Apr 14 16:12:06 user nova-compute[71500]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04, portal: 172.16.0.220,3260] successful.
Apr 14 16:12:06 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2947891b-11ba-4dc1-9435-83fe187e0f04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd52194-68e0-41b9-8350-2bd6798edca0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] <== disconnect_volume: return (322ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:12:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Deleting instance files /opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57_del
Apr 14 16:12:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Deletion of /opt/stack/data/nova/instances/8fbd3667-302e-4f1f-8e58-2bdabe5efe57_del complete
Apr 14 16:12:06 user nova-compute[71500]: INFO nova.compute.manager [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 16:12:06 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:12:06 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:07 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Took 0.67 seconds to deallocate network for instance.
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-deleted-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:07 user nova-compute[71500]: INFO nova.compute.manager [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Neutron deleted interface f572c852-fb5c-4ceb-aac4-4be593331f83; detaching it from the instance and deleting it from the info cache
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.network.neutron [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-a1b473ab-935c-418e-b02c-ec3eda668c67 req-e8d79029-1d3b-4793-ad7d-2050457fc12c service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Detach interface failed, port_id=f572c852-fb5c-4ceb-aac4-4be593331f83, reason: Instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-unplugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Acquiring lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] No waiting events found dispatching network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:12:07 user nova-compute[71500]: WARNING nova.compute.manager [req-b3202b6c-b63e-4137-a619-8e6fdfce8b44 req-a36a4cb6-1f8f-4339-a619-b24effe652bd service nova] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Received unexpected event network-vif-plugged-f572c852-fb5c-4ceb-aac4-4be593331f83 for instance with vm_state active and task_state deleting.
Apr 14 16:12:08 user nova-compute[71500]: INFO nova.compute.manager [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 16:12:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Deleting volume: 2947891b-11ba-4dc1-9435-83fe187e0f04 {{(pid=71500) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 16:12:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:08 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:12:08 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:12:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:08 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Deleted allocations for instance 8fbd3667-302e-4f1f-8e58-2bdabe5efe57
Apr 14 16:12:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-8484cb5f-b4a9-461a-b2d5-cc9bb79a7c68 tempest-TestShelveInstance-1830025798 tempest-TestShelveInstance-1830025798-project-member] Lock "8fbd3667-302e-4f1f-8e58-2bdabe5efe57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.054s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:21 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488726.1876092, 8fbd3667-302e-4f1f-8e58-2bdabe5efe57 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:12:21 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] VM Stopped (Lifecycle Event)
Apr 14 16:12:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-901a4d3f-49ba-4881-847f-d51ba8db1840 None None] [instance: 8fbd3667-302e-4f1f-8e58-2bdabe5efe57] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:12:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:12:23 user nova-compute[71500]: INFO nova.compute.claims [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Claim successful on node user
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:12:23 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:12:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Verify base images {{(pid=71500) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Image id e3a0daa8-78ae-44af-8756-1fad21c352f3 yields fingerprint f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 {{(pid=71500) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] image e3a0daa8-78ae-44af-8756-1fad21c352f3 at (/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0): checking
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] image e3a0daa8-78ae-44af-8756-1fad21c352f3 at (/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0): image is in use {{(pid=71500) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71500) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] f1963f30-fea7-49f0-aa6d-5df33a362258 is a valid instance name {{(pid=71500) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] f1963f30-fea7-49f0-aa6d-5df33a362258 has a disk file {{(pid=71500) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.policy [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Creating image(s)
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "/opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "/opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f1963f30-fea7-49f0-aa6d-5df33a362258 is backed by f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 {{(pid=71500) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f
Apr 14 16:12:24 user nova-compute[71500]: WARNING nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Active base files: /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Removable base files: /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872 /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36 /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411 /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68 /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940 /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9 /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04fbb7029f6ac680673d31a34f0c7fcaf6620872
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bcaf448678d5ba2d392d5ed899fb90aaa727ac36
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/557b59394bb213603d988dbe0527296d7b1f7411
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dbd5284ea07f32d0ec14bc022e7616b3aa36cd68
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3dccdb36e3fcaea72c2496ed07e716a93bbe3940
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/487efba3ab87d725bb0adce287942e98070bfafc
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/590ae696743c231c4e6862d46573684b4801efd9
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f1ac2641e3e032590530f4a725101bd73513746f
Apr 14 16:12:24 user nova-compute[71500]: INFO nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4991d1389101f4e1ff470fb320454ab45cd9f278
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Verification complete {{(pid=71500) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Verify swap images {{(pid=71500) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.imagecache [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Verify ephemeral images {{(pid=71500) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.151s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk 1073741824" returned: 0 in 0.050s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Cannot resize image /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.objects.instance [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lazy-loading 'migration_context' on Instance uuid f5355a43-4e93-484e-87ad-6e179c8821c2 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Ensure instance console log exists: /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Successfully created port: fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Successfully updated port: fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquired lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-changed-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.compute.manager [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Refreshing instance network info cache due to event network-changed-fd90e988-80fd-4292-af7a-719a534d38db. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Acquiring lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.neutron [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updating instance_info_cache with network_info: [{"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Releasing lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Instance network_info: |[{"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Acquired lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.neutron [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Refreshing network info cache for port fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Start _get_guest_xml network_info=[{"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:12:25 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:12:25 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-340591422',display_name='tempest-VolumesActionsTest-instance-340591422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-340591422',id=38,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15fb9ccf20ec4ef2a6b64004df0061e4',ramdisk_id='',reservation_id='r-t4obhl1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-452608968',owner_user_name='tempest-VolumesActionsTest-452608968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:12:24Z,user_data=None,user_id='6061fcff5317445cab3a8da6f24d9ba4',uuid=f5355a43-4e93-484e-87ad-6e179c8821c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converting VIF {"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.objects.instance [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lazy-loading 'pci_devices' on Instance uuid f5355a43-4e93-484e-87ad-6e179c8821c2 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:12:25 user nova-compute[71500]:   <uuid>f5355a43-4e93-484e-87ad-6e179c8821c2</uuid>
Apr 14 16:12:25 user nova-compute[71500]:   <name>instance-00000026</name>
Apr 14 16:12:25 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:12:25 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:12:25 user nova-compute[71500]:   <metadata>
Apr 14 16:12:25 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:12:25 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:12:25 user nova-compute[71500]:       <nova:name>tempest-VolumesActionsTest-instance-340591422</nova:name>
Apr 14 16:12:25 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:12:25</nova:creationTime>
Apr 14 16:12:25 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:12:25 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:12:25 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:12:25 user nova-compute[71500]:       <nova:owner>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:user uuid="6061fcff5317445cab3a8da6f24d9ba4">tempest-VolumesActionsTest-452608968-project-member</nova:user>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:project uuid="15fb9ccf20ec4ef2a6b64004df0061e4">tempest-VolumesActionsTest-452608968</nova:project>
Apr 14 16:12:25 user nova-compute[71500]:       </nova:owner>
Apr 14 16:12:25 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:12:25 user nova-compute[71500]:       <nova:ports>
Apr 14 16:12:25 user nova-compute[71500]:         <nova:port uuid="fd90e988-80fd-4292-af7a-719a534d38db">
Apr 14 16:12:25 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 16:12:25 user nova-compute[71500]:         </nova:port>
Apr 14 16:12:25 user nova-compute[71500]:       </nova:ports>
Apr 14 16:12:25 user nova-compute[71500]:     </nova:instance>
Apr 14 16:12:25 user nova-compute[71500]:   </metadata>
Apr 14 16:12:25 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:12:25 user nova-compute[71500]:     <system>
Apr 14 16:12:25 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:12:25 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:12:25 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:12:25 user nova-compute[71500]:       <entry name="serial">f5355a43-4e93-484e-87ad-6e179c8821c2</entry>
Apr 14 16:12:25 user nova-compute[71500]:       <entry name="uuid">f5355a43-4e93-484e-87ad-6e179c8821c2</entry>
Apr 14 16:12:25 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:12:25 user nova-compute[71500]:     </system>
Apr 14 16:12:25 user nova-compute[71500]:   </sysinfo>
Apr 14 16:12:25 user nova-compute[71500]:   <os>
Apr 14 16:12:25 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:12:25 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:12:25 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:12:25 user nova-compute[71500]:   </os>
Apr 14 16:12:25 user nova-compute[71500]:   <features>
Apr 14 16:12:25 user nova-compute[71500]:     <acpi/>
Apr 14 16:12:25 user nova-compute[71500]:     <apic/>
Apr 14 16:12:25 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:12:25 user nova-compute[71500]:   </features>
Apr 14 16:12:25 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:12:25 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:12:25 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:12:25 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:12:25 user nova-compute[71500]:   </clock>
Apr 14 16:12:25 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:12:25 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:12:25 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:12:25 user nova-compute[71500]:   </cpu>
Apr 14 16:12:25 user nova-compute[71500]:   <devices>
Apr 14 16:12:25 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:12:25 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:12:25 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk"/>
Apr 14 16:12:25 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:12:25 user nova-compute[71500]:     </disk>
Apr 14 16:12:25 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:12:25 user nova-compute[71500]:       <mac address="fa:16:3e:53:10:04"/>
Apr 14 16:12:25 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:12:25 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:12:25 user nova-compute[71500]:       <target dev="tapfd90e988-80"/>
Apr 14 16:12:25 user nova-compute[71500]:     </interface>
Apr 14 16:12:25 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:12:25 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/console.log" append="off"/>
Apr 14 16:12:25 user nova-compute[71500]:     </serial>
Apr 14 16:12:25 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:12:25 user nova-compute[71500]:     <video>
Apr 14 16:12:25 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:12:25 user nova-compute[71500]:     </video>
Apr 14 16:12:25 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:12:25 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:12:25 user nova-compute[71500]:     </rng>
Apr 14 16:12:25 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:12:25 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:12:25 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:12:25 user nova-compute[71500]:     </memballoon>
Apr 14 16:12:25 user nova-compute[71500]:   </devices>
Apr 14 16:12:25 user nova-compute[71500]: </domain>
Apr 14 16:12:25 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-340591422',display_name='tempest-VolumesActionsTest-instance-340591422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-340591422',id=38,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15fb9ccf20ec4ef2a6b64004df0061e4',ramdisk_id='',reservation_id='r-t4obhl1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-452608968',owner_user_name='tempest-VolumesActionsTest-452608968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:12:24Z,user_data=None,user_id='6061fcff5317445cab3a8da6f24d9ba4',uuid=f5355a43-4e93-484e-87ad-6e179c8821c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converting VIF {"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG os_vif [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd90e988-80, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd90e988-80, col_values=(('external_ids', {'iface-id': 'fd90e988-80fd-4292-af7a-719a534d38db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:10:04', 'vm-uuid': 'f5355a43-4e93-484e-87ad-6e179c8821c2'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:12:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:25 user nova-compute[71500]: INFO os_vif [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80')
Apr 14 16:12:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:12:26 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] No VIF found with MAC fa:16:3e:53:10:04, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:12:26 user nova-compute[71500]: DEBUG nova.network.neutron [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updated VIF entry in instance network info cache for port fd90e988-80fd-4292-af7a-719a534d38db. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:12:26 user nova-compute[71500]: DEBUG nova.network.neutron [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updating instance_info_cache with network_info: [{"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:26 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-56e3d366-21d3-4bf6-bff1-125b3c6b91e9 req-e06cbe56-f06a-42bd-ac4a-30ef56dda10f service nova] Releasing lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:27 user nova-compute[71500]: DEBUG nova.compute.manager [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] No waiting events found dispatching network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:12:27 user nova-compute[71500]: WARNING nova.compute.manager [req-b2ef1697-f580-47e8-83f4-aeef84ac58a1 req-dc5fcc9c-01c9-4777-ac5a-0267e2493e54 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received unexpected event network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db for instance with vm_state building and task_state spawning.
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488749.406036, f5355a43-4e93-484e-87ad-6e179c8821c2 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] VM Resumed (Lifecycle Event)
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Instance spawned successfully.
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488749.407761, f5355a43-4e93-484e-87ad-6e179c8821c2 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] VM Started (Lifecycle Event)
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:12:29 user nova-compute[71500]: INFO nova.compute.manager [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Took 5.98 seconds to build instance.
Apr 14 16:12:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-131365e7-d06d-459a-a866-91857e51ee80 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.073s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] No waiting events found dispatching network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:12:29 user nova-compute[71500]: WARNING nova.compute.manager [req-76d0b6e5-59dd-423b-96ea-2e8d24ea6737 req-8002bd9e-b434-4ad9-abf4-61c6d2c9564a service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received unexpected event network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db for instance with vm_state active and task_state None.
Apr 14 16:12:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-changed-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Refreshing instance network info cache due to event network-changed-a088891b-f698-4783-8b4d-caacf03d3747. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Acquiring lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Acquired lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Refreshing network info cache for port a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updated VIF entry in instance network info cache for port a088891b-f698-4783-8b4d-caacf03d3747. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG nova.network.neutron [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updating instance_info_cache with network_info: [{"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:12:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b98d3bf2-97b9-4361-b9c8-341ec0778939 req-02ace24d-d9a6-4750-800d-44a841b6dcc2 service nova] Releasing lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:12:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:35 user nova-compute[71500]: INFO nova.compute.manager [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Attaching volume 3fe10619-864c-47ef-85f3-184510e76ebd to /dev/vdb
Apr 14 16:12:35 user nova-compute[71500]: DEBUG os_brick.utils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90f59d3-bdac-4134-b7a4-92d5b4fbe24d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[459b9f7f-b734-440a-be26-6d1ca356795c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5767a0-5273-4179-a282-7ac3c108a54c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[be576883-fc7f-42d9-834c-fd9a0827dd30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:12:35 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:12:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3073e33b-5032-41da-bd68-5daf671dcc95]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG os_brick.utils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updating existing volume attachment record: 25410a22-acb3-4b51-be74-2bc9e503154c {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:12:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHrVBTGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:12:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:12:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:12:40 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90789f-3905-442f-8be3-11703f3107f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:12:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cbb9b8-d342-44a3-a587-3c67ba3c690d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd] added
Apr 14 16:12:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3329c4-9aff-4568-88e8-5eb97ad7d972]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f35d0e-f86a-4133-8ae4-5fc50633619b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHrVBTGL {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHrVBTGL" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbe5c56-f0bd-41fd-9839-013584c45153]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OHrVBTGL'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c45e6-627e-4cea-894d-e05d31d746ea]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eaf413-b864-4bdf-ad12-2788a2f7e155]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:12:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:12:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:12:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:12:40 user nova-compute[71500]: 
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f893e7-a128-4f38-863f-7cfac5591b57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260]
Apr 14 16:12:40 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260] successful.
Apr 14 16:12:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf97659-68f1-4b7d-aa66-986cf053e833]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[50788c02-8ae9-4a17-b35e-1eeba0e85497]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd (non-flash)
Apr 14 16:12:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd (non-flash)
Apr 14 16:12:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd89c5-523c-4b45-8ef9-d57260ee733b]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHrVBTGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:12:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23135616631333736', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135616631333736', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 16:12:41 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:12:41 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 16:12:41 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:12:41 user nova-compute[71500]:   <serial>3fe10619-864c-47ef-85f3-184510e76ebd</serial>
Apr 14 16:12:41 user nova-compute[71500]: </disk>
Apr 14 16:12:41 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:12:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] No VIF found with MAC fa:16:3e:c4:7b:d3, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:12:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-166ac644-0277-4869-86b7-ede7bf514f68 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.846s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:12:43 user nova-compute[71500]: INFO nova.compute.manager [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Detaching volume 3fe10619-864c-47ef-85f3-184510e76ebd
Apr 14 16:12:43 user nova-compute[71500]: INFO nova.virt.block_device [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Attempting to driver detach volume 3fe10619-864c-47ef-85f3-184510e76ebd from mountpoint /dev/vdb
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Attempting to detach device vdb from instance f1963f30-fea7-49f0-aa6d-5df33a362258 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:12:43 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:12:43 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 16:12:43 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:12:43 user nova-compute[71500]:   <serial>3fe10619-864c-47ef-85f3-184510e76ebd</serial>
Apr 14 16:12:43 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:12:43 user nova-compute[71500]: </disk>
Apr 14 16:12:43 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:12:43 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully detached device vdb from instance f1963f30-fea7-49f0-aa6d-5df33a362258 from the persistent domain config.
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1963f30-fea7-49f0-aa6d-5df33a362258 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:12:43 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:12:43 user nova-compute[71500]:   <source dev="/dev/sdb"/>
Apr 14 16:12:43 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:12:43 user nova-compute[71500]:   <serial>3fe10619-864c-47ef-85f3-184510e76ebd</serial>
Apr 14 16:12:43 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:12:43 user nova-compute[71500]: </disk>
Apr 14 16:12:43 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681488763.7999115, f1963f30-fea7-49f0-aa6d-5df33a362258 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 16:12:43 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully detached device vdb from instance f1963f30-fea7-49f0-aa6d-5df33a362258 from the live domain config.
Apr 14 16:12:43 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHrVBTGL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:12:43 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef911989-0ecd-4a83-9274-3a6d4f35d678]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:12:43 user nova-compute[71500]: No targets found.
Apr 14 16:12:43 user nova-compute[71500]: iSNS:
Apr 14 16:12:43 user nova-compute[71500]: No targets found.
Apr 14 16:12:43 user nova-compute[71500]: STATIC:
Apr 14 16:12:43 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd
Apr 14 16:12:43 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:12:43 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:12:43 user nova-compute[71500]: FIRMWARE:
Apr 14 16:12:43 user nova-compute[71500]: No targets found.
Apr 14 16:12:43 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:12:43 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:12:43 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8488d5-893f-4730-914b-9d8717eaccdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26b74c7-dd69-4b56-a61d-4ef3b138b098]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd (non-flash)
Apr 14 16:12:43 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd (non-flash)
Apr 14 16:12:43 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc6730a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1ced5-b84f-4c65-9293-2f7718d838a5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[94834934-43bc-478f-abb5-4c3042102ca7]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d6725-d5fb-4c23-9f30-fa86e9a8a71f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bd510-fa6a-4cf7-b238-c79b70de13f0]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:12:43 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[03810a22-5c52-4052-bc6f-df0e0ff10106]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c4a184-7ec3-4026-b623-4da2e68c310e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260]
Apr 14 16:12:44 user nova-compute[71500]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd, portal: 172.16.0.220,3260] successful.
Apr 14 16:12:44 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fe10619-864c-47ef-85f3-184510e76ebd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced308d-bb56-4d29-afc2-ef8c66897dc1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] <== disconnect_volume: return (277ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG nova.objects.instance [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'flavor' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:12:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-fdc6d100-0a53-47ef-86cd-0726f495be35 tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:12:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:12:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updating instance_info_cache with network_info: [{"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-f1963f30-fea7-49f0-aa6d-5df33a362258" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:13:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:04 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:13:04 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=26.095958709716797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f1963f30-fea7-49f0-aa6d-5df33a362258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f5355a43-4e93-484e-87ad-6e179c8821c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:10 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:10 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 16:13:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 16:13:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 16:13:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "54af8caf-09fa-4ada-b446-91e43876581a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:13:29 user nova-compute[71500]: INFO nova.compute.claims [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Claim successful on node user
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:13:29 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:13:29 user nova-compute[71500]: INFO nova.virt.block_device [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Booting with volume snapshot 798fb31f-f689-4dde-8a93-4365398d456f at /dev/vda
Apr 14 16:13:29 user nova-compute[71500]: DEBUG nova.policy [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:13:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Successfully created port: b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:13:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Successfully updated port: b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:13:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:13:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquired lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:13:30 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-changed-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.compute.manager [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Refreshing instance network info cache due to event network-changed-b31de579-1646-47cd-a9d8-9e45df05addf. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Acquiring lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updating instance_info_cache with network_info: [{"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Releasing lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Instance network_info: |[{"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Acquired lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Refreshing network info cache for port b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updated VIF entry in instance network info cache for port b31de579-1646-47cd-a9d8-9e45df05addf. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG nova.network.neutron [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updating instance_info_cache with network_info: [{"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:13:31 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5a95991b-40f4-41e2-9bf3-d6c4149a6842 req-cce8e4ab-8560-475f-8077-3472d9d681e8 service nova] Releasing lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:33 user nova-compute[71500]: INFO nova.compute.manager [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Terminating instance
Apr 14 16:13:33 user nova-compute[71500]: DEBUG nova.compute.manager [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-vif-unplugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] No waiting events found dispatching network-vif-unplugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-7edda3c7-4e83-4758-af7a-e85fff2406be req-66ca2663-a54f-412f-bc0f-bab0dc4dfcf5 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-vif-unplugged-a088891b-f698-4783-8b4d-caacf03d3747 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:13:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Instance destroyed successfully.
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.objects.instance [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lazy-loading 'resources' on Instance uuid f1963f30-fea7-49f0-aa6d-5df33a362258 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:10:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2085721900',display_name='tempest-AttachVolumeNegativeTest-server-2085721900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2085721900',id=37,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMies72o3CTJZcRAOo1f/8fx+L36gTla/KTevmmTBxnCOJ4l2fhCY8Lh+4u86skeMnTKY3SGVCASxcYOcS2vN2SDP9c5xB/Mx9DXTuFAMVvifMjJD8BK8/dZ0BuqCqyVpw==',key_name='tempest-keypair-2020858187',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:10:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecb4d204dbf24c19b978456d16d19e87',ramdisk_id='',reservation_id='r-tsaf907b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-378331452',owner_user_name='tempest-AttachVolumeNegativeTest-378331452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d83796cd8d5464fa4e580844441da81',uuid=f1963f30-fea7-49f0-aa6d-5df33a362258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converting VIF {"id": "a088891b-f698-4783-8b4d-caacf03d3747", "address": "fa:16:3e:c4:7b:d3", "network": {"id": "5deec755-9819-4003-820a-2b9360f5dc62", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1710185112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecb4d204dbf24c19b978456d16d19e87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa088891b-f6", "ovs_interfaceid": "a088891b-f698-4783-8b4d-caacf03d3747", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG os_vif [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa088891b-f6, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:13:34 user nova-compute[71500]: INFO os_vif [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:7b:d3,bridge_name='br-int',has_traffic_filtering=True,id=a088891b-f698-4783-8b4d-caacf03d3747,network=Network(5deec755-9819-4003-820a-2b9360f5dc62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa088891b-f6')
Apr 14 16:13:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Deleting instance files /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258_del
Apr 14 16:13:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Deletion of /opt/stack/data/nova/instances/f1963f30-fea7-49f0-aa6d-5df33a362258_del complete
Apr 14 16:13:34 user nova-compute[71500]: INFO nova.compute.manager [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 14 16:13:34 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:13:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG os_brick.utils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1c46d2-083f-4427-96a5-d8709ddca17a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525a426-381d-4ffb-a819-25f26da5c0f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b18d141-65ae-4286-8b46-d975581be31b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[07859e34-b78a-485e-968d-dcea4711c49f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:13:35 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56b4b30-6436-4651-b431-d4d2cb971aa7]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG os_brick.utils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updating existing volume attachment record: 5a95793e-0fb0-45a4-9f26-872729b200f5 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:13:35 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Took 0.95 seconds to deallocate network for instance.
Apr 14 16:13:35 user nova-compute[71500]: DEBUG nova.compute.manager [req-d57608be-d8e8-4893-8802-34fbc995b8f8 req-932352eb-9fda-4f23-95a8-aa0111933682 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-vif-deleted-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:35 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Deleted allocations for instance f1963f30-fea7-49f0-aa6d-5df33a362258
Apr 14 16:13:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-07d76bb1-c418-4756-80b1-837199f78d7c tempest-AttachVolumeNegativeTest-378331452 tempest-AttachVolumeNegativeTest-378331452-project-member] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received event network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:13:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Acquiring lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] Lock "f1963f30-fea7-49f0-aa6d-5df33a362258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] No waiting events found dispatching network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:13:36 user nova-compute[71500]: WARNING nova.compute.manager [req-fd5da5de-a183-4f91-b772-5c2386c88673 req-3c5c4cfb-52ef-4811-acdd-8ea7f0d9e096 service nova] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Received unexpected event network-vif-plugged-a088891b-f698-4783-8b4d-caacf03d3747 for instance with vm_state deleted and task_state None.
Apr 14 16:13:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:13:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Creating image(s)
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Ensure instance console log exists: /opt/stack/data/nova/instances/54af8caf-09fa-4ada-b446-91e43876581a/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Start _get_guest_xml network_info=[{"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '5a95793e-0fb0-45a4-9f26-872729b200f5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saIuMqfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54af8caf-09fa-4ada-b446-91e43876581a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a61afe1d-37b8-465c-a609-14d51956961e', 'serial': 'a61afe1d-37b8-465c-a609-14d51956961e'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:13:40 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:13:40 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saIuMqfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:13:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:13:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:13:40 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba83f2-64ea-4439-b045-feb502cb0b6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:13:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac61d5b6-e45b-437a-8e34-3ca977657eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e] added
Apr 14 16:13:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[486d5b8a-9c92-44cb-abbb-58259330607d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6803e362-b1e5-4d68-b8c1-e84998004cd3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saIuMqfG {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v saIuMqfG" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2944c56f-f58f-4883-b052-3eadc60522e9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'saIuMqfG'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f58813-b406-425e-8ed0-54c13e3eee4b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7337215-8b04-41d6-acc2-434874c441ef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:13:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:13:40 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:13:40 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:13:40 user nova-compute[71500]: 
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c89a45-62c9-4142-8f57-59f8a32cb5ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260]
Apr 14 16:13:40 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260] successful.
Apr 14 16:13:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5c9bc3-47c3-476f-82e0-b204b509c729]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0006ef-fcc1-411b-bc91-0246538b9971]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e (non-flash)
Apr 14 16:13:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e (non-flash)
Apr 14 16:13:40 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[09505a68-6dff-40b6-8690-774d193c0f44]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:13:40 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:13:41 user nova-compute[71500]: WARNING nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid f5355a43-4e93-484e-87ad-6e179c8821c2 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 54af8caf-09fa-4ada-b446-91e43876581a {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saIuMqfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23937383434333532', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937383434333532', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1494473776',display_name='tempest-TestVolumeBootPattern-server-1494473776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1494473776',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-tpv38eu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:13:29Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=54af8caf-09fa-4ada-b446-91e43876581a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'pci_devices' on Instance uuid 54af8caf-09fa-4ada-b446-91e43876581a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:13:41 user nova-compute[71500]:   <uuid>54af8caf-09fa-4ada-b446-91e43876581a</uuid>
Apr 14 16:13:41 user nova-compute[71500]:   <name>instance-00000027</name>
Apr 14 16:13:41 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:13:41 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:13:41 user nova-compute[71500]:   <metadata>
Apr 14 16:13:41 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:13:41 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:13:41 user nova-compute[71500]:       <nova:name>tempest-TestVolumeBootPattern-server-1494473776</nova:name>
Apr 14 16:13:41 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:13:40</nova:creationTime>
Apr 14 16:13:41 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:13:41 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:13:41 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:13:41 user nova-compute[71500]:       <nova:owner>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:user uuid="bb3b7ae19e044c3e90292751dd633279">tempest-TestVolumeBootPattern-1344751469-project-member</nova:user>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:project uuid="2ffc20a7a2f44e5cafb12334ea4230eb">tempest-TestVolumeBootPattern-1344751469</nova:project>
Apr 14 16:13:41 user nova-compute[71500]:       </nova:owner>
Apr 14 16:13:41 user nova-compute[71500]:       <nova:ports>
Apr 14 16:13:41 user nova-compute[71500]:         <nova:port uuid="b31de579-1646-47cd-a9d8-9e45df05addf">
Apr 14 16:13:41 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 16:13:41 user nova-compute[71500]:         </nova:port>
Apr 14 16:13:41 user nova-compute[71500]:       </nova:ports>
Apr 14 16:13:41 user nova-compute[71500]:     </nova:instance>
Apr 14 16:13:41 user nova-compute[71500]:   </metadata>
Apr 14 16:13:41 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:13:41 user nova-compute[71500]:     <system>
Apr 14 16:13:41 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:13:41 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:13:41 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:13:41 user nova-compute[71500]:       <entry name="serial">54af8caf-09fa-4ada-b446-91e43876581a</entry>
Apr 14 16:13:41 user nova-compute[71500]:       <entry name="uuid">54af8caf-09fa-4ada-b446-91e43876581a</entry>
Apr 14 16:13:41 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:13:41 user nova-compute[71500]:     </system>
Apr 14 16:13:41 user nova-compute[71500]:   </sysinfo>
Apr 14 16:13:41 user nova-compute[71500]:   <os>
Apr 14 16:13:41 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:13:41 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:13:41 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:13:41 user nova-compute[71500]:   </os>
Apr 14 16:13:41 user nova-compute[71500]:   <features>
Apr 14 16:13:41 user nova-compute[71500]:     <acpi/>
Apr 14 16:13:41 user nova-compute[71500]:     <apic/>
Apr 14 16:13:41 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:13:41 user nova-compute[71500]:   </features>
Apr 14 16:13:41 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:13:41 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:13:41 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:13:41 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:13:41 user nova-compute[71500]:   </clock>
Apr 14 16:13:41 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:13:41 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:13:41 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:13:41 user nova-compute[71500]:   </cpu>
Apr 14 16:13:41 user nova-compute[71500]:   <devices>
Apr 14 16:13:41 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:13:41 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:13:41 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 16:13:41 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:13:41 user nova-compute[71500]:       <serial>a61afe1d-37b8-465c-a609-14d51956961e</serial>
Apr 14 16:13:41 user nova-compute[71500]:     </disk>
Apr 14 16:13:41 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:13:41 user nova-compute[71500]:       <mac address="fa:16:3e:69:03:aa"/>
Apr 14 16:13:41 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:13:41 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:13:41 user nova-compute[71500]:       <target dev="tapb31de579-16"/>
Apr 14 16:13:41 user nova-compute[71500]:     </interface>
Apr 14 16:13:41 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:13:41 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/54af8caf-09fa-4ada-b446-91e43876581a/console.log" append="off"/>
Apr 14 16:13:41 user nova-compute[71500]:     </serial>
Apr 14 16:13:41 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:13:41 user nova-compute[71500]:     <video>
Apr 14 16:13:41 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:13:41 user nova-compute[71500]:     </video>
Apr 14 16:13:41 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:13:41 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:13:41 user nova-compute[71500]:     </rng>
Apr 14 16:13:41 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:13:41 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:13:41 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:13:41 user nova-compute[71500]:     </memballoon>
Apr 14 16:13:41 user nova-compute[71500]:   </devices>
Apr 14 16:13:41 user nova-compute[71500]: </domain>
Apr 14 16:13:41 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1494473776',display_name='tempest-TestVolumeBootPattern-server-1494473776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1494473776',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-tpv38eu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:13:29Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=54af8caf-09fa-4ada-b446-91e43876581a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG os_vif [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb31de579-16, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb31de579-16, col_values=(('external_ids', {'iface-id': 'b31de579-1646-47cd-a9d8-9e45df05addf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:03:aa', 'vm-uuid': '54af8caf-09fa-4ada-b446-91e43876581a'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:41 user nova-compute[71500]: INFO os_vif [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16')
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:13:41 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No VIF found with MAC fa:16:3e:69:03:aa, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG nova.compute.manager [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:42 user nova-compute[71500]: DEBUG nova.compute.manager [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] No waiting events found dispatching network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:13:42 user nova-compute[71500]: WARNING nova.compute.manager [req-37693e7b-2ee8-4e0c-ad51-daa3574965c4 req-dad74c9a-6f2b-40c3-b861-f3448ed6c6c0 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received unexpected event network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf for instance with vm_state building and task_state spawning.
Apr 14 16:13:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488824.8235722, 54af8caf-09fa-4ada-b446-91e43876581a => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:13:44 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] VM Resumed (Lifecycle Event)
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:13:44 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Instance spawned successfully.
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:13:44 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488824.8260214, 54af8caf-09fa-4ada-b446-91e43876581a => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:13:44 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] VM Started (Lifecycle Event)
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:13:44 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:13:44 user nova-compute[71500]: INFO nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Took 4.88 seconds to spawn the instance on the hypervisor.
Apr 14 16:13:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:13:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:13:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:13:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] No waiting events found dispatching network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:13:45 user nova-compute[71500]: WARNING nova.compute.manager [req-9b8f7ad7-464f-47ef-beb9-3773d2e29af1 req-70d79fc9-10e1-49fb-ac21-4546f4b3f129 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received unexpected event network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf for instance with vm_state building and task_state spawning.
Apr 14 16:13:45 user nova-compute[71500]: INFO nova.compute.manager [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Took 16.01 seconds to build instance.
Apr 14 16:13:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d185c274-363c-49b0-8d3b-bdb9e29a4780 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "54af8caf-09fa-4ada-b446-91e43876581a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.105s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "54af8caf-09fa-4ada-b446-91e43876581a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.789s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:13:45 user nova-compute[71500]: INFO nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:13:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "54af8caf-09fa-4ada-b446-91e43876581a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:13:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:49 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488814.3281245, f1963f30-fea7-49f0-aa6d-5df33a362258 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:13:49 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] VM Stopped (Lifecycle Event)
Apr 14 16:13:49 user nova-compute[71500]: DEBUG nova.compute.manager [None req-044fe35a-57f3-42d1-bb7d-3bd46e54b447 None None] [instance: f1963f30-fea7-49f0-aa6d-5df33a362258] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:13:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:13:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:00 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid f5355a43-4e93-484e-87ad-6e179c8821c2 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updating instance_info_cache with network_info: [{"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:14:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-f5355a43-4e93-484e-87ad-6e179c8821c2" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:14:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:14:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:14:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:14:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:14:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8573MB free_disk=26.09703826904297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance f5355a43-4e93-484e-87ad-6e179c8821c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 54af8caf-09fa-4ada-b446-91e43876581a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:14:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:14:06 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:14:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:14:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:14:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:14 user nova-compute[71500]: INFO nova.compute.manager [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Terminating instance
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-vif-unplugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] No waiting events found dispatching network-vif-unplugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.compute.manager [req-cb7a5649-7388-4bf3-82db-7a88f118707d req-d70e0732-79bd-4f17-b19a-d0fbc13f21eb service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-vif-unplugged-fd90e988-80fd-4292-af7a-719a534d38db for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Instance destroyed successfully.
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lazy-loading 'resources' on Instance uuid f5355a43-4e93-484e-87ad-6e179c8821c2 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-340591422',display_name='tempest-VolumesActionsTest-instance-340591422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-340591422',id=38,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:12:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15fb9ccf20ec4ef2a6b64004df0061e4',ramdisk_id='',reservation_id='r-t4obhl1r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-452608968',owner_user_name='tempest-VolumesActionsTest-452608968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:12:30Z,user_data=None,user_id='6061fcff5317445cab3a8da6f24d9ba4',uuid=f5355a43-4e93-484e-87ad-6e179c8821c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converting VIF {"id": "fd90e988-80fd-4292-af7a-719a534d38db", "address": "fa:16:3e:53:10:04", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd90e988-80", "ovs_interfaceid": "fd90e988-80fd-4292-af7a-719a534d38db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG os_vif [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd90e988-80, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:14:14 user nova-compute[71500]: INFO os_vif [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:10:04,bridge_name='br-int',has_traffic_filtering=True,id=fd90e988-80fd-4292-af7a-719a534d38db,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd90e988-80')
Apr 14 16:14:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Deleting instance files /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2_del
Apr 14 16:14:14 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Deletion of /opt/stack/data/nova/instances/f5355a43-4e93-484e-87ad-6e179c8821c2_del complete
Apr 14 16:14:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:14 user nova-compute[71500]: INFO nova.compute.manager [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 16:14:14 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:14:14 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:14:15 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Took 0.55 seconds to deallocate network for instance.
Apr 14 16:14:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-vif-deleted-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:14:15 user nova-compute[71500]: INFO nova.compute.manager [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Neutron deleted interface fd90e988-80fd-4292-af7a-719a534d38db; detaching it from the instance and deleting it from the info cache
Apr 14 16:14:15 user nova-compute[71500]: DEBUG nova.network.neutron [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG nova.compute.manager [req-c7f3f0db-6ef1-4c83-a614-0596acdd7063 req-5d2cae81-9439-4781-8745-2a0f2d959264 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Detach interface failed, port_id=fd90e988-80fd-4292-af7a-719a534d38db, reason: Instance f5355a43-4e93-484e-87ad-6e179c8821c2 could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:14:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:15 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Deleted allocations for instance f5355a43-4e93-484e-87ad-6e179c8821c2
Apr 14 16:14:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-22f6bfca-e0b6-487d-b69f-8ac5776948d7 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.577s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received event network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:14:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Acquiring lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:14:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:14:16 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] Lock "f5355a43-4e93-484e-87ad-6e179c8821c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:14:16 user nova-compute[71500]: DEBUG nova.compute.manager [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] No waiting events found dispatching network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:14:16 user nova-compute[71500]: WARNING nova.compute.manager [req-abf28d94-9f64-436a-8b06-9da87599adf4 req-875ba7a3-5948-41c3-b942-1319dbce7860 service nova] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Received unexpected event network-vif-plugged-fd90e988-80fd-4292-af7a-719a534d38db for instance with vm_state deleted and task_state None.
Apr 14 16:14:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:14:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:14:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:14:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:14:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:14:29 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488854.773855, f5355a43-4e93-484e-87ad-6e179c8821c2 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:14:29 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] VM Stopped (Lifecycle Event)
Apr 14 16:14:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-e4240fd2-6e80-4cf1-b592-d446be535151 None None] [instance: f5355a43-4e93-484e-87ad-6e179c8821c2] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:14:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:14:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:14:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:14:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:14:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:14:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:14:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:14:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:14:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:14:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:14:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updating instance_info_cache with network_info: [{"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-54af8caf-09fa-4ada-b446-91e43876581a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:15:02 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:04 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:15:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:15:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:15:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=26.113525390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 54af8caf-09fa-4ada-b446-91e43876581a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:15:05 user nova-compute[71500]: INFO nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e has allocations against this compute host but is not found in the database.
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:15:05 user nova-compute[71500]: INFO nova.compute.claims [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Claim successful on node user
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:15:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:15:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Creating image(s)
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "/opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "/opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "/opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.policy [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6061fcff5317445cab3a8da6f24d9ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15fb9ccf20ec4ef2a6b64004df0061e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk 1073741824" returned: 0 in 0.049s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Checking if we can resize image /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Cannot resize image /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lazy-loading 'migration_context' on Instance uuid caa3fcc9-1f1f-4983-adcd-bd005dd1691e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Ensure instance console log exists: /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:07 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Successfully created port: 1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:15:07 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Successfully updated port: 1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:15:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:15:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquired lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:15:07 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:15:07 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-changed-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Refreshing instance network info cache due to event network-changed-1e22337c-e160-4d43-a04d-5195c921531a. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Acquiring lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updating instance_info_cache with network_info: [{"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Releasing lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Instance network_info: |[{"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Acquired lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.neutron [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Refreshing network info cache for port 1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Start _get_guest_xml network_info=[{"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:15:08 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:15:08 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794843664',display_name='tempest-VolumesActionsTest-instance-1794843664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794843664',id=40,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15fb9ccf20ec4ef2a6b64004df0061e4',ramdisk_id='',reservation_id='r-i1zrv6fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-452608968',owner_user_name='tempest-VolumesActionsTest-452608968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:15:06Z,user_data=None,user_id='6061fcff5317445cab3a8da6f24d9ba4',uuid=caa3fcc9-1f1f-4983-adcd-bd005dd1691e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converting VIF {"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lazy-loading 'pci_devices' on Instance uuid caa3fcc9-1f1f-4983-adcd-bd005dd1691e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:15:08 user nova-compute[71500]:   <uuid>caa3fcc9-1f1f-4983-adcd-bd005dd1691e</uuid>
Apr 14 16:15:08 user nova-compute[71500]:   <name>instance-00000028</name>
Apr 14 16:15:08 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:15:08 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:15:08 user nova-compute[71500]:   <metadata>
Apr 14 16:15:08 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:15:08 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:15:08 user nova-compute[71500]:       <nova:name>tempest-VolumesActionsTest-instance-1794843664</nova:name>
Apr 14 16:15:08 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:15:08</nova:creationTime>
Apr 14 16:15:08 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:15:08 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:15:08 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:15:08 user nova-compute[71500]:       <nova:owner>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:user uuid="6061fcff5317445cab3a8da6f24d9ba4">tempest-VolumesActionsTest-452608968-project-member</nova:user>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:project uuid="15fb9ccf20ec4ef2a6b64004df0061e4">tempest-VolumesActionsTest-452608968</nova:project>
Apr 14 16:15:08 user nova-compute[71500]:       </nova:owner>
Apr 14 16:15:08 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:15:08 user nova-compute[71500]:       <nova:ports>
Apr 14 16:15:08 user nova-compute[71500]:         <nova:port uuid="1e22337c-e160-4d43-a04d-5195c921531a">
Apr 14 16:15:08 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 16:15:08 user nova-compute[71500]:         </nova:port>
Apr 14 16:15:08 user nova-compute[71500]:       </nova:ports>
Apr 14 16:15:08 user nova-compute[71500]:     </nova:instance>
Apr 14 16:15:08 user nova-compute[71500]:   </metadata>
Apr 14 16:15:08 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:15:08 user nova-compute[71500]:     <system>
Apr 14 16:15:08 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:15:08 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:15:08 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:15:08 user nova-compute[71500]:       <entry name="serial">caa3fcc9-1f1f-4983-adcd-bd005dd1691e</entry>
Apr 14 16:15:08 user nova-compute[71500]:       <entry name="uuid">caa3fcc9-1f1f-4983-adcd-bd005dd1691e</entry>
Apr 14 16:15:08 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:15:08 user nova-compute[71500]:     </system>
Apr 14 16:15:08 user nova-compute[71500]:   </sysinfo>
Apr 14 16:15:08 user nova-compute[71500]:   <os>
Apr 14 16:15:08 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:15:08 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:15:08 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:15:08 user nova-compute[71500]:   </os>
Apr 14 16:15:08 user nova-compute[71500]:   <features>
Apr 14 16:15:08 user nova-compute[71500]:     <acpi/>
Apr 14 16:15:08 user nova-compute[71500]:     <apic/>
Apr 14 16:15:08 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:15:08 user nova-compute[71500]:   </features>
Apr 14 16:15:08 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:15:08 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:15:08 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:15:08 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:15:08 user nova-compute[71500]:   </clock>
Apr 14 16:15:08 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:15:08 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:15:08 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:15:08 user nova-compute[71500]:   </cpu>
Apr 14 16:15:08 user nova-compute[71500]:   <devices>
Apr 14 16:15:08 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:15:08 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:15:08 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk"/>
Apr 14 16:15:08 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:15:08 user nova-compute[71500]:     </disk>
Apr 14 16:15:08 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:15:08 user nova-compute[71500]:       <mac address="fa:16:3e:95:20:4b"/>
Apr 14 16:15:08 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:15:08 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:15:08 user nova-compute[71500]:       <target dev="tap1e22337c-e1"/>
Apr 14 16:15:08 user nova-compute[71500]:     </interface>
Apr 14 16:15:08 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:15:08 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/console.log" append="off"/>
Apr 14 16:15:08 user nova-compute[71500]:     </serial>
Apr 14 16:15:08 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:15:08 user nova-compute[71500]:     <video>
Apr 14 16:15:08 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:15:08 user nova-compute[71500]:     </video>
Apr 14 16:15:08 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:15:08 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:15:08 user nova-compute[71500]:     </rng>
Apr 14 16:15:08 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:15:08 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:15:08 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:15:08 user nova-compute[71500]:     </memballoon>
Apr 14 16:15:08 user nova-compute[71500]:   </devices>
Apr 14 16:15:08 user nova-compute[71500]: </domain>
Apr 14 16:15:08 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794843664',display_name='tempest-VolumesActionsTest-instance-1794843664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794843664',id=40,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15fb9ccf20ec4ef2a6b64004df0061e4',ramdisk_id='',reservation_id='r-i1zrv6fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-452608968',owner_user_name='tempest-VolumesActionsTest-452608968-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:15:06Z,user_data=None,user_id='6061fcff5317445cab3a8da6f24d9ba4',uuid=caa3fcc9-1f1f-4983-adcd-bd005dd1691e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converting VIF {"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG os_vif [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e22337c-e1, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e22337c-e1, col_values=(('external_ids', {'iface-id': '1e22337c-e160-4d43-a04d-5195c921531a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:20:4b', 'vm-uuid': 'caa3fcc9-1f1f-4983-adcd-bd005dd1691e'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:08 user nova-compute[71500]: INFO os_vif [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1')
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] No VIF found with MAC fa:16:3e:95:20:4b, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.neutron [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updated VIF entry in instance network info cache for port 1e22337c-e160-4d43-a04d-5195c921531a. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:15:08 user nova-compute[71500]: DEBUG nova.network.neutron [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updating instance_info_cache with network_info: [{"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32f25a34-ee5f-4ea7-b351-1527afcc9bbf req-ee3ec112-b4e5-4182-882f-6e44bfc88910 service nova] Releasing lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] No waiting events found dispatching network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:15:09 user nova-compute[71500]: WARNING nova.compute.manager [req-b912c25e-223f-4f24-a0bc-e421d5da5429 req-398a3559-1629-4ae7-b980-9bd0145b1974 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received unexpected event network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a for instance with vm_state building and task_state spawning.
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488911.8887286, caa3fcc9-1f1f-4983-adcd-bd005dd1691e => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:15:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] VM Resumed (Lifecycle Event)
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:15:11 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Instance spawned successfully.
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:15:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488911.8907974, caa3fcc9-1f1f-4983-adcd-bd005dd1691e => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:15:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] VM Started (Lifecycle Event)
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:15:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:15:11 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:15:12 user nova-compute[71500]: INFO nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 14 16:15:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:15:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:15:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:12 user nova-compute[71500]: DEBUG nova.compute.manager [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] No waiting events found dispatching network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:15:12 user nova-compute[71500]: WARNING nova.compute.manager [req-825432f9-06af-4f67-a466-64241abc2e3e req-64d8ccae-3aa7-472c-9916-41b17c934709 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received unexpected event network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a for instance with vm_state building and task_state spawning.
Apr 14 16:15:12 user nova-compute[71500]: INFO nova.compute.manager [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Took 6.26 seconds to build instance.
Apr 14 16:15:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4ff10a06-12b1-4b90-a5bf-4eea3c26e5d1 tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.372s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:15:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "54af8caf-09fa-4ada-b446-91e43876581a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:20 user nova-compute[71500]: INFO nova.compute.manager [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Terminating instance
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-vif-unplugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] No waiting events found dispatching network-vif-unplugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.compute.manager [req-7cc6c2e5-a8de-468e-ba0e-d39d6192a030 req-1d04d5f8-8dac-42a0-982e-8c2facf6e118 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-vif-unplugged-b31de579-1646-47cd-a9d8-9e45df05addf for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:15:20 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Instance destroyed successfully.
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'resources' on Instance uuid 54af8caf-09fa-4ada-b446-91e43876581a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1494473776',display_name='tempest-TestVolumeBootPattern-server-1494473776',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1494473776',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:13:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-tpv38eu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:13:45Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=54af8caf-09fa-4ada-b446-91e43876581a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "b31de579-1646-47cd-a9d8-9e45df05addf", "address": "fa:16:3e:69:03:aa", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb31de579-16", "ovs_interfaceid": "b31de579-1646-47cd-a9d8-9e45df05addf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_vif [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb31de579-16, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:20 user nova-compute[71500]: INFO os_vif [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=b31de579-1646-47cd-a9d8-9e45df05addf,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb31de579-16')
Apr 14 16:15:20 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'saIuMqfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:15:20 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9d9bd-9407-4050-bd6b-873501c0a5f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:15:20 user nova-compute[71500]: No targets found.
Apr 14 16:15:20 user nova-compute[71500]: iSNS:
Apr 14 16:15:20 user nova-compute[71500]: No targets found.
Apr 14 16:15:20 user nova-compute[71500]: STATIC:
Apr 14 16:15:20 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e
Apr 14 16:15:20 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:15:20 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:15:20 user nova-compute[71500]: FIRMWARE:
Apr 14 16:15:20 user nova-compute[71500]: No targets found.
Apr 14 16:15:20 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:15:20 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:15:20 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:15:20 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a862ad-a685-4c16-b68e-24b0e36c72e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfa6b89-f3ad-4f17-978f-a5e7938c96e9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e (non-flash)
Apr 14 16:15:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e (non-flash)
Apr 14 16:15:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc61ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726fd5d-c2a1-457a-8456-1de60eb46366]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a92fec2-098c-40d6-944c-3dc8b4e2dda2]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76986e2-367d-4ef0-b7bb-bbe9514536e1]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2743fb-4d33-4b89-8115-d7cd27d47569]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7e1f980-97844352f6791d78', '/dev/disk/by-id/scsi-23937383434333532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7e1f980') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[996c9a42-6c9e-4c09-91d8-c7c005a9b160]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e105e55a-c15f-4d05-b132-eadce857e347]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[173fcbbc-5eb5-4ee2-aaa3-9b280dd12b38]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260]
Apr 14 16:15:21 user nova-compute[71500]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e, portal: 172.16.0.220,3260] successful.
Apr 14 16:15:21 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a61afe1d-37b8-465c-a609-14d51956961e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[46825f87-8be3-4701-96cd-668e3ee1a254]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== disconnect_volume: return (302ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:15:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Deleting instance files /opt/stack/data/nova/instances/54af8caf-09fa-4ada-b446-91e43876581a_del
Apr 14 16:15:21 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Deletion of /opt/stack/data/nova/instances/54af8caf-09fa-4ada-b446-91e43876581a_del complete
Apr 14 16:15:21 user nova-compute[71500]: INFO nova.compute.manager [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 14 16:15:21 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:15:21 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:15:22 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:15:22 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Took 1.09 seconds to deallocate network for instance.
Apr 14 16:15:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:15:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Acquiring lock "54af8caf-09fa-4ada-b446-91e43876581a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] Lock "54af8caf-09fa-4ada-b446-91e43876581a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] No waiting events found dispatching network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:15:22 user nova-compute[71500]: WARNING nova.compute.manager [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received unexpected event network-vif-plugged-b31de579-1646-47cd-a9d8-9e45df05addf for instance with vm_state active and task_state deleting.
Apr 14 16:15:22 user nova-compute[71500]: DEBUG nova.compute.manager [req-c68f8a77-4786-4784-b1e2-fb3d3b521393 req-10dfa5b2-b5f5-4eed-b094-f2c8b3692871 service nova] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Received event network-vif-deleted-b31de579-1646-47cd-a9d8-9e45df05addf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:15:23 user nova-compute[71500]: INFO nova.compute.manager [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 16:15:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Deleting volume: a61afe1d-37b8-465c-a609-14d51956961e {{(pid=71500) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 16:15:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:15:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:15:23 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:15:23 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:15:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:23 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Deleted allocations for instance 54af8caf-09fa-4ada-b446-91e43876581a
Apr 14 16:15:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9b876966-5ba9-4a9f-b9a4-3ed3ca73fe18 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "54af8caf-09fa-4ada-b446-91e43876581a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.547s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:15:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:35 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681488920.9306283, 54af8caf-09fa-4ada-b446-91e43876581a => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:15:35 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] VM Stopped (Lifecycle Event)
Apr 14 16:15:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-74814a68-9366-4b37-a873-c8ded5315f02 None None] [instance: 54af8caf-09fa-4ada-b446-91e43876581a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:15:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:15:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:15:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:15:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:15:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:15:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:03 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid caa3fcc9-1f1f-4983-adcd-bd005dd1691e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updating instance_info_cache with network_info: [{"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-caa3fcc9-1f1f-4983-adcd-bd005dd1691e" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:16:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:16:05 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=26.083091735839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:16:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:16:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:16:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:16:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:16:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:16:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:16:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:16:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "375e1073-5299-4d9d-8100-6f626e4bf122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:16:22 user nova-compute[71500]: INFO nova.compute.claims [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Claim successful on node user
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:16:22 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:16:22 user nova-compute[71500]: INFO nova.virt.block_device [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Booting with volume ded1e85d-494f-490d-9ddc-7d7b9bc8c020 at /dev/vda
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.policy [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG os_brick.utils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce546f-dfd6-4a21-af70-a59cf1a22a90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c2a528-af90-4088-bb8b-86cd0e3e9b5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd4825-0bc5-4a18-8cd0-b82cfdc28d4d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0438087-268a-4b38-a8c5-5164d759ae79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:16:22 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:16:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e250245-ec51-4a88-aeec-8ec6e2a8b6da]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG os_brick.utils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating existing volume attachment record: 837e3bac-5aea-44c7-9d66-b6e325985d15 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:16:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Successfully created port: c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Successfully updated port: c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquired lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-changed-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG nova.compute.manager [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Refreshing instance network info cache due to event network-changed-c83d0ffe-900d-4f39-bd31-2db21e0870f7. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:16:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Acquiring lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating instance_info_cache with network_info: [{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Releasing lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Instance network_info: |[{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Acquired lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Refreshing network info cache for port c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updated VIF entry in instance network info cache for port c83d0ffe-900d-4f39-bd31-2db21e0870f7. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG nova.network.neutron [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating instance_info_cache with network_info: [{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:16:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f49d4ff5-e561-49f8-8ba1-f726aa2dad2e req-1d3a27b8-a8b1-4893-9e30-a8f07273ce92 service nova] Releasing lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:16:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:16:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Creating image(s)
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Ensure instance console log exists: /opt/stack/data/nova/instances/375e1073-5299-4d9d-8100-6f626e4bf122/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Start _get_guest_xml network_info=[{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '837e3bac-5aea-44c7-9d66-b6e325985d15', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbsEUkTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '375e1073-5299-4d9d-8100-6f626e4bf122', 'attached_at': '', 'detached_at': '', 'volume_id': 'ded1e85d-494f-490d-9ddc-7d7b9bc8c020', 'serial': 'ded1e85d-494f-490d-9ddc-7d7b9bc8c020'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:16:27 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:16:27 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbsEUkTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:16:27 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:16:27 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:16:27 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[158fbdf5-81f3-4948-b5ac-6208c037eb52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:16:27 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0bc3f6-3879-4fe8-9697-25f0831990b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020] added
Apr 14 16:16:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cdfbe5-579e-425f-856f-4c269f50acec]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f67046-9fdb-4498-bb57-d305daf79014]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbsEUkTe {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbsEUkTe" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca5b9b-c8cb-478a-a8c7-a4d6c827dd75]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbsEUkTe'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d91614-bc9e-4d33-a8ef-8ccff510c535]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d1bb5e-b416-43db-93bc-ef36624846f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:16:27 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:16:27 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:16:27 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:16:27 user nova-compute[71500]: 
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2b5f47-5938-4b93-89d0-6db5f35848ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260]
Apr 14 16:16:27 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260] successful.
Apr 14 16:16:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca3ea93-5d38-4b0a-b4d2-12bcafdb14e7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e262f6f-f42b-4054-9468-18a685ef7468]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:16:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:16:27 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c143d9-fc23-44f5-9f5c-4e6c1b15a9dc]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:16:27 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbsEUkTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:16:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:16:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23932383766643963', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:16:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932383766643963', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-345674687',display_name='tempest-TestVolumeBootPattern-volume-backed-server-345674687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-345674687',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-r7n6r89k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:16:23Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=375e1073-5299-4d9d-8100-6f626e4bf122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'pci_devices' on Instance uuid 375e1073-5299-4d9d-8100-6f626e4bf122 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:16:29 user nova-compute[71500]:   <uuid>375e1073-5299-4d9d-8100-6f626e4bf122</uuid>
Apr 14 16:16:29 user nova-compute[71500]:   <name>instance-00000029</name>
Apr 14 16:16:29 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:16:29 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:16:29 user nova-compute[71500]:   <metadata>
Apr 14 16:16:29 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:16:29 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:16:29 user nova-compute[71500]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-345674687</nova:name>
Apr 14 16:16:29 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:16:27</nova:creationTime>
Apr 14 16:16:29 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:16:29 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:16:29 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:16:29 user nova-compute[71500]:       <nova:owner>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:user uuid="bb3b7ae19e044c3e90292751dd633279">tempest-TestVolumeBootPattern-1344751469-project-member</nova:user>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:project uuid="2ffc20a7a2f44e5cafb12334ea4230eb">tempest-TestVolumeBootPattern-1344751469</nova:project>
Apr 14 16:16:29 user nova-compute[71500]:       </nova:owner>
Apr 14 16:16:29 user nova-compute[71500]:       <nova:ports>
Apr 14 16:16:29 user nova-compute[71500]:         <nova:port uuid="c83d0ffe-900d-4f39-bd31-2db21e0870f7">
Apr 14 16:16:29 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 16:16:29 user nova-compute[71500]:         </nova:port>
Apr 14 16:16:29 user nova-compute[71500]:       </nova:ports>
Apr 14 16:16:29 user nova-compute[71500]:     </nova:instance>
Apr 14 16:16:29 user nova-compute[71500]:   </metadata>
Apr 14 16:16:29 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:16:29 user nova-compute[71500]:     <system>
Apr 14 16:16:29 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:16:29 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:16:29 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:16:29 user nova-compute[71500]:       <entry name="serial">375e1073-5299-4d9d-8100-6f626e4bf122</entry>
Apr 14 16:16:29 user nova-compute[71500]:       <entry name="uuid">375e1073-5299-4d9d-8100-6f626e4bf122</entry>
Apr 14 16:16:29 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:16:29 user nova-compute[71500]:     </system>
Apr 14 16:16:29 user nova-compute[71500]:   </sysinfo>
Apr 14 16:16:29 user nova-compute[71500]:   <os>
Apr 14 16:16:29 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:16:29 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:16:29 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:16:29 user nova-compute[71500]:   </os>
Apr 14 16:16:29 user nova-compute[71500]:   <features>
Apr 14 16:16:29 user nova-compute[71500]:     <acpi/>
Apr 14 16:16:29 user nova-compute[71500]:     <apic/>
Apr 14 16:16:29 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:16:29 user nova-compute[71500]:   </features>
Apr 14 16:16:29 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:16:29 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:16:29 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:16:29 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:16:29 user nova-compute[71500]:   </clock>
Apr 14 16:16:29 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:16:29 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:16:29 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:16:29 user nova-compute[71500]:   </cpu>
Apr 14 16:16:29 user nova-compute[71500]:   <devices>
Apr 14 16:16:29 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:16:29 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:16:29 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 16:16:29 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:16:29 user nova-compute[71500]:       <serial>ded1e85d-494f-490d-9ddc-7d7b9bc8c020</serial>
Apr 14 16:16:29 user nova-compute[71500]:     </disk>
Apr 14 16:16:29 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:16:29 user nova-compute[71500]:       <mac address="fa:16:3e:1e:9a:c3"/>
Apr 14 16:16:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:16:29 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:16:29 user nova-compute[71500]:       <target dev="tapc83d0ffe-90"/>
Apr 14 16:16:29 user nova-compute[71500]:     </interface>
Apr 14 16:16:29 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:16:29 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/375e1073-5299-4d9d-8100-6f626e4bf122/console.log" append="off"/>
Apr 14 16:16:29 user nova-compute[71500]:     </serial>
Apr 14 16:16:29 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:16:29 user nova-compute[71500]:     <video>
Apr 14 16:16:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:16:29 user nova-compute[71500]:     </video>
Apr 14 16:16:29 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:16:29 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:16:29 user nova-compute[71500]:     </rng>
Apr 14 16:16:29 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:16:29 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:16:29 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:16:29 user nova-compute[71500]:     </memballoon>
Apr 14 16:16:29 user nova-compute[71500]:   </devices>
Apr 14 16:16:29 user nova-compute[71500]: </domain>
Apr 14 16:16:29 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-345674687',display_name='tempest-TestVolumeBootPattern-volume-backed-server-345674687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-345674687',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-r7n6r89k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:16:23Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=375e1073-5299-4d9d-8100-6f626e4bf122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG os_vif [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83d0ffe-90, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc83d0ffe-90, col_values=(('external_ids', {'iface-id': 'c83d0ffe-900d-4f39-bd31-2db21e0870f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:9a:c3', 'vm-uuid': '375e1073-5299-4d9d-8100-6f626e4bf122'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:29 user nova-compute[71500]: INFO os_vif [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90')
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No VIF found with MAC fa:16:3e:1e:9a:c3, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:16:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG nova.compute.manager [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] No waiting events found dispatching network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:16:30 user nova-compute[71500]: WARNING nova.compute.manager [req-b07a8a2a-93d0-454b-884f-5fd25e87698f req-f827e2db-319e-412a-86b9-52dba22f74d7 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received unexpected event network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance with vm_state building and task_state spawning.
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488992.4276485, 375e1073-5299-4d9d-8100-6f626e4bf122 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] VM Resumed (Lifecycle Event)
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Instance spawned successfully.
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681488992.4325407, 375e1073-5299-4d9d-8100-6f626e4bf122 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] VM Started (Lifecycle Event)
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] No waiting events found dispatching network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:16:32 user nova-compute[71500]: WARNING nova.compute.manager [req-51202d69-085e-4ed7-8fcb-b8013b6de2d9 req-3531e499-eebc-4f97-9172-e90e78dc6e62 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received unexpected event network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance with vm_state building and task_state spawning.
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Took 4.92 seconds to spawn the instance on the hypervisor.
Apr 14 16:16:32 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:16:32 user nova-compute[71500]: INFO nova.compute.manager [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Took 10.47 seconds to build instance.
Apr 14 16:16:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ad673b33-e465-4402-aeb5-f91b833fc838 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "375e1073-5299-4d9d-8100-6f626e4bf122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.572s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:16:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:16:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:56 user nova-compute[71500]: INFO nova.compute.manager [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Terminating instance
Apr 14 16:16:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:16:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-vif-unplugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] No waiting events found dispatching network-vif-unplugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.compute.manager [req-fa453e24-6b62-4145-8dc0-a5e2545b6046 req-75f3bd6f-de1a-4442-a071-5aa65f0037bb service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-vif-unplugged-1e22337c-e160-4d43-a04d-5195c921531a for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:16:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Instance destroyed successfully.
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.objects.instance [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lazy-loading 'resources' on Instance uuid caa3fcc9-1f1f-4983-adcd-bd005dd1691e {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1794843664',display_name='tempest-VolumesActionsTest-instance-1794843664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1794843664',id=40,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15fb9ccf20ec4ef2a6b64004df0061e4',ramdisk_id='',reservation_id='r-i1zrv6fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-452608968',owner_user_name='tempest-VolumesActionsTest-452608968-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:15:12Z,user_data=None,user_id='6061fcff5317445cab3a8da6f24d9ba4',uuid=caa3fcc9-1f1f-4983-adcd-bd005dd1691e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converting VIF {"id": "1e22337c-e160-4d43-a04d-5195c921531a", "address": "fa:16:3e:95:20:4b", "network": {"id": "69b009a5-c526-4ef9-9ba2-ad9c03e24e34", "bridge": "br-int", "label": "tempest-VolumesActionsTest-77870036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "15fb9ccf20ec4ef2a6b64004df0061e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e22337c-e1", "ovs_interfaceid": "1e22337c-e160-4d43-a04d-5195c921531a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG os_vif [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e22337c-e1, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:16:57 user nova-compute[71500]: INFO os_vif [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:20:4b,bridge_name='br-int',has_traffic_filtering=True,id=1e22337c-e160-4d43-a04d-5195c921531a,network=Network(69b009a5-c526-4ef9-9ba2-ad9c03e24e34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e22337c-e1')
Apr 14 16:16:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Deleting instance files /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e_del
Apr 14 16:16:57 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Deletion of /opt/stack/data/nova/instances/caa3fcc9-1f1f-4983-adcd-bd005dd1691e_del complete
Apr 14 16:16:57 user nova-compute[71500]: INFO nova.compute.manager [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 16:16:57 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:16:57 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:16:58 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Took 0.53 seconds to deallocate network for instance.
Apr 14 16:16:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-vif-deleted-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:16:58 user nova-compute[71500]: INFO nova.compute.manager [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Neutron deleted interface 1e22337c-e160-4d43-a04d-5195c921531a; detaching it from the instance and deleting it from the info cache
Apr 14 16:16:58 user nova-compute[71500]: DEBUG nova.network.neutron [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG nova.compute.manager [req-def74e51-c1a8-40e3-9269-1c0bededa3fc req-2174b3a6-6ca4-44ad-ace3-47fa684caa44 service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Detach interface failed, port_id=1e22337c-e160-4d43-a04d-5195c921531a, reason: Instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e could not be found. {{(pid=71500) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:16:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:58 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Deleted allocations for instance caa3fcc9-1f1f-4983-adcd-bd005dd1691e
Apr 14 16:16:58 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-4b4517fe-28b3-432b-8a27-2c329725a24c tempest-VolumesActionsTest-452608968 tempest-VolumesActionsTest-452608968-project-member] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.712s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received event network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:16:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Acquiring lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:16:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:16:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] Lock "caa3fcc9-1f1f-4983-adcd-bd005dd1691e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:16:59 user nova-compute[71500]: DEBUG nova.compute.manager [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] No waiting events found dispatching network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:16:59 user nova-compute[71500]: WARNING nova.compute.manager [req-9d57889c-0ba6-43d7-8f02-42813fb8e1d1 req-47ad7770-29cd-432f-91c1-a39af5ecde6c service nova] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Received unexpected event network-vif-plugged-1e22337c-e160-4d43-a04d-5195c921531a for instance with vm_state deleted and task_state None.
Apr 14 16:16:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 375e1073-5299-4d9d-8100-6f626e4bf122 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating instance_info_cache with network_info: [{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:17:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:17:06 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:17:06 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=26.09885025024414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 375e1073-5299-4d9d-8100-6f626e4bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:17:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:17:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:08 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489017.4514062, caa3fcc9-1f1f-4983-adcd-bd005dd1691e => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:17:12 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] VM Stopped (Lifecycle Event)
Apr 14 16:17:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1345dad4-9487-46e8-af74-936aec455fe0 None None] [instance: caa3fcc9-1f1f-4983-adcd-bd005dd1691e] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:17:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:17:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:17:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:17:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:17:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:17:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:17:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:17:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:17:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 375e1073-5299-4d9d-8100-6f626e4bf122 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating instance_info_cache with network_info: [{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:18:05 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:18:06 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:18:06 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.36883544921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 375e1073-5299-4d9d-8100-6f626e4bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:18:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:08 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 16:18:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:18:17 user nova-compute[71500]: INFO nova.compute.claims [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Claim successful on node user
Apr 14 16:18:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:17 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:18:17 user nova-compute[71500]: INFO nova.virt.block_device [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Booting with volume snapshot a62f8b6c-ec93-41d6-ba1c-a02e35ac69f5 at /dev/vda
Apr 14 16:18:17 user nova-compute[71500]: DEBUG nova.policy [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:18:18 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Successfully created port: ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Successfully updated port: ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "refresh_cache-8f8afdbf-f148-4447-a480-dbbb17fc45ea" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquired lock "refresh_cache-8f8afdbf-f148-4447-a480-dbbb17fc45ea" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-changed-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.compute.manager [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Refreshing instance network info cache due to event network-changed-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Acquiring lock "refresh_cache-8f8afdbf-f148-4447-a480-dbbb17fc45ea" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Updating instance_info_cache with network_info: [{"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Releasing lock "refresh_cache-8f8afdbf-f148-4447-a480-dbbb17fc45ea" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Instance network_info: |[{"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Acquired lock "refresh_cache-8f8afdbf-f148-4447-a480-dbbb17fc45ea" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:18:19 user nova-compute[71500]: DEBUG nova.network.neutron [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Refreshing network info cache for port ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:18:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Updated VIF entry in instance network info cache for port ac9e2d3b-e929-4fac-b9ae-8af8aa53b465. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:18:20 user nova-compute[71500]: DEBUG nova.network.neutron [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Updating instance_info_cache with network_info: [{"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:18:20 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c8be8ecc-c323-46d8-9700-ae42e8602ecf req-0b7fbb84-4de8-4c8d-bf1f-d8f5ef07b553 service nova] Releasing lock "refresh_cache-8f8afdbf-f148-4447-a480-dbbb17fc45ea" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:18:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG os_brick.utils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab262f3-448e-4a6a-be0a-e639a8e41c6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7f885-158b-4730-9493-6ff1335fcff1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ac7c2-70be-498a-9a5e-de31b554a751]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b982e8f6-0a70-478d-8c45-a58048934734]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:18:23 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:18:23 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49379f8-3080-449a-8fcf-5273455d5a23]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG os_brick.utils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:18:23 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Updating existing volume attachment record: 663dc924-4e1b-4173-8c7b-dde210e91e2d {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:18:27 user nova-compute[71500]: INFO nova.compute.claims [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Claim successful on node user
Apr 14 16:18:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:18:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.policy [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:18:27 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Creating image(s)
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "/opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "/opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:27 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.166s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk 1073741824" returned: 0 in 0.049s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.142s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:18:28 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Creating image(s)
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Ensure instance console log exists: /opt/stack/data/nova/instances/8f8afdbf-f148-4447-a480-dbbb17fc45ea/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Start _get_guest_xml network_info=[{"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T16:18:13Z,direct_url=<?>,disk_format='qcow2',id=0e4f659b-d29c-4f4f-b2df-b08af690bed4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-772270288',owner='2ffc20a7a2f44e5cafb12334ea4230eb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T16:18:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '663dc924-4e1b-4173-8c7b-dde210e91e2d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekDUuRzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f8afdbf-f148-4447-a480-dbbb17fc45ea', 'attached_at': '', 'detached_at': '', 'volume_id': '0e034314-7a16-475b-a993-e56064a2f916', 'serial': '0e034314-7a16-475b-a993-e56064a2f916'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Successfully created port: 45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:18:28 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:18:28 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T16:18:13Z,direct_url=<?>,disk_format='qcow2',id=0e4f659b-d29c-4f4f-b2df-b08af690bed4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-772270288',owner='2ffc20a7a2f44e5cafb12334ea4230eb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T16:18:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekDUuRzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:18:28 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:18:28 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:18:28 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Cannot resize image /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'migration_context' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3280b180-9a50-4484-b0b9-71e2c45a7ec7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:18:28 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Ensure instance console log exists: /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ccc942-d695-4784-93cf-65b9961faa70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916] added
Apr 14 16:18:28 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a769a3-ecc1-4443-b8bd-b0b734e07aa9]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da002ae-f9fb-4651-8fb0-78acc636d1d0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekDUuRzH {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ekDUuRzH" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83eca96-be8b-449e-90d0-ecca69cf34e8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ekDUuRzH'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485c928-3c9b-45d2-876a-da6895639557]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e15e10-832a-4e39-adf2-9984a7f44003]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:18:28 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:18:28 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447ae2b-8932-4a57-9d7d-690d39532f37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260]
Apr 14 16:18:28 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260] successful.
Apr 14 16:18:28 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b7a903-5141-4b5b-9bb4-d95a6ab32f82]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[593e52f1-d908-496c-8622-0aae57d80d7c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:18:28 user nova-compute[71500]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 (non-flash)
Apr 14 16:18:28 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:18:28 user nova-compute[71500]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 (non-flash)
Apr 14 16:18:28 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c0c7e8-ed8b-469a-a874-f4adbac13a33]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:18:28 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekDUuRzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Successfully updated port: 45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquired lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-changed-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.compute.manager [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Refreshing instance network info cache due to event network-changed-45b6be70-59dc-4cbe-a5c9-9a6feab419cf. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Acquiring lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.neutron [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updating instance_info_cache with network_info: [{"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Releasing lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Instance network_info: |[{"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Acquired lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.neutron [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Refreshing network info cache for port 45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Start _get_guest_xml network_info=[{"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:18:29 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:18:29 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1886734098',display_name='tempest-VolumesSnapshotTestJSON-instance-1886734098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1886734098',id=43,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78327b280e74412bd43a54a522c20d0',ramdisk_id='',reservation_id='r-i44mopzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1091655053',owner_user_name='tempest-VolumesSnapshotTestJSON-1091655053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:18:28Z,user_data=None,user_id='ffdaf3dc40b0445ea03d2f69abd46924',uuid=7d0b5baa-3cec-4162-b27e-fa2665134f2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converting VIF {"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:18:29 user nova-compute[71500]:   <uuid>7d0b5baa-3cec-4162-b27e-fa2665134f2a</uuid>
Apr 14 16:18:29 user nova-compute[71500]:   <name>instance-0000002b</name>
Apr 14 16:18:29 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:18:29 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:18:29 user nova-compute[71500]:   <metadata>
Apr 14 16:18:29 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:18:29 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1886734098</nova:name>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:18:29</nova:creationTime>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:18:29 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:18:29 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:owner>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:user uuid="ffdaf3dc40b0445ea03d2f69abd46924">tempest-VolumesSnapshotTestJSON-1091655053-project-member</nova:user>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:project uuid="e78327b280e74412bd43a54a522c20d0">tempest-VolumesSnapshotTestJSON-1091655053</nova:project>
Apr 14 16:18:29 user nova-compute[71500]:       </nova:owner>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:ports>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:port uuid="45b6be70-59dc-4cbe-a5c9-9a6feab419cf">
Apr 14 16:18:29 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 16:18:29 user nova-compute[71500]:         </nova:port>
Apr 14 16:18:29 user nova-compute[71500]:       </nova:ports>
Apr 14 16:18:29 user nova-compute[71500]:     </nova:instance>
Apr 14 16:18:29 user nova-compute[71500]:   </metadata>
Apr 14 16:18:29 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:18:29 user nova-compute[71500]:     <system>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="serial">7d0b5baa-3cec-4162-b27e-fa2665134f2a</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="uuid">7d0b5baa-3cec-4162-b27e-fa2665134f2a</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:18:29 user nova-compute[71500]:     </system>
Apr 14 16:18:29 user nova-compute[71500]:   </sysinfo>
Apr 14 16:18:29 user nova-compute[71500]:   <os>
Apr 14 16:18:29 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:18:29 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:18:29 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:18:29 user nova-compute[71500]:   </os>
Apr 14 16:18:29 user nova-compute[71500]:   <features>
Apr 14 16:18:29 user nova-compute[71500]:     <acpi/>
Apr 14 16:18:29 user nova-compute[71500]:     <apic/>
Apr 14 16:18:29 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:18:29 user nova-compute[71500]:   </features>
Apr 14 16:18:29 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:18:29 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:18:29 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:18:29 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:18:29 user nova-compute[71500]:   </clock>
Apr 14 16:18:29 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:18:29 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:18:29 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:18:29 user nova-compute[71500]:   </cpu>
Apr 14 16:18:29 user nova-compute[71500]:   <devices>
Apr 14 16:18:29 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:18:29 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:18:29 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk"/>
Apr 14 16:18:29 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:18:29 user nova-compute[71500]:     </disk>
Apr 14 16:18:29 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:18:29 user nova-compute[71500]:       <mac address="fa:16:3e:c8:b8:c9"/>
Apr 14 16:18:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:18:29 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:18:29 user nova-compute[71500]:       <target dev="tap45b6be70-59"/>
Apr 14 16:18:29 user nova-compute[71500]:     </interface>
Apr 14 16:18:29 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:18:29 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/console.log" append="off"/>
Apr 14 16:18:29 user nova-compute[71500]:     </serial>
Apr 14 16:18:29 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:18:29 user nova-compute[71500]:     <video>
Apr 14 16:18:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:18:29 user nova-compute[71500]:     </video>
Apr 14 16:18:29 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:18:29 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:18:29 user nova-compute[71500]:     </rng>
Apr 14 16:18:29 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:18:29 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:18:29 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:18:29 user nova-compute[71500]:     </memballoon>
Apr 14 16:18:29 user nova-compute[71500]:   </devices>
Apr 14 16:18:29 user nova-compute[71500]: </domain>
Apr 14 16:18:29 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1886734098',display_name='tempest-VolumesSnapshotTestJSON-instance-1886734098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1886734098',id=43,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78327b280e74412bd43a54a522c20d0',ramdisk_id='',reservation_id='r-i44mopzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1091655053',owner_user_name='tempest-VolumesSnapshotTestJSON-1091655053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:18:28Z,user_data=None,user_id='ffdaf3dc40b0445ea03d2f69abd46924',uuid=7d0b5baa-3cec-4162-b27e-fa2665134f2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converting VIF {"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG os_vif [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45b6be70-59, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45b6be70-59, col_values=(('external_ids', {'iface-id': '45b6be70-59dc-4cbe-a5c9-9a6feab419cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:b8:c9', 'vm-uuid': '7d0b5baa-3cec-4162-b27e-fa2665134f2a'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: INFO os_vif [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59')
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No VIF found with MAC fa:16:3e:c8:b8:c9, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23434353336616330', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434353336616330', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1337435188',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1337435188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1337435188',id=42,image_ref='0e4f659b-d29c-4f4f-b2df-b08af690bed4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-04cygcb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1344751469',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:18:18Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=8f8afdbf-f148-4447-a480-dbbb17fc45ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f8afdbf-f148-4447-a480-dbbb17fc45ea {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:18:29 user nova-compute[71500]:   <uuid>8f8afdbf-f148-4447-a480-dbbb17fc45ea</uuid>
Apr 14 16:18:29 user nova-compute[71500]:   <name>instance-0000002a</name>
Apr 14 16:18:29 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:18:29 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:18:29 user nova-compute[71500]:   <metadata>
Apr 14 16:18:29 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:18:29 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1337435188</nova:name>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:18:28</nova:creationTime>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:18:29 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:18:29 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:owner>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:user uuid="bb3b7ae19e044c3e90292751dd633279">tempest-TestVolumeBootPattern-1344751469-project-member</nova:user>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:project uuid="2ffc20a7a2f44e5cafb12334ea4230eb">tempest-TestVolumeBootPattern-1344751469</nova:project>
Apr 14 16:18:29 user nova-compute[71500]:       </nova:owner>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:root type="image" uuid="0e4f659b-d29c-4f4f-b2df-b08af690bed4"/>
Apr 14 16:18:29 user nova-compute[71500]:       <nova:ports>
Apr 14 16:18:29 user nova-compute[71500]:         <nova:port uuid="ac9e2d3b-e929-4fac-b9ae-8af8aa53b465">
Apr 14 16:18:29 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 16:18:29 user nova-compute[71500]:         </nova:port>
Apr 14 16:18:29 user nova-compute[71500]:       </nova:ports>
Apr 14 16:18:29 user nova-compute[71500]:     </nova:instance>
Apr 14 16:18:29 user nova-compute[71500]:   </metadata>
Apr 14 16:18:29 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:18:29 user nova-compute[71500]:     <system>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="serial">8f8afdbf-f148-4447-a480-dbbb17fc45ea</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="uuid">8f8afdbf-f148-4447-a480-dbbb17fc45ea</entry>
Apr 14 16:18:29 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:18:29 user nova-compute[71500]:     </system>
Apr 14 16:18:29 user nova-compute[71500]:   </sysinfo>
Apr 14 16:18:29 user nova-compute[71500]:   <os>
Apr 14 16:18:29 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:18:29 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:18:29 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:18:29 user nova-compute[71500]:   </os>
Apr 14 16:18:29 user nova-compute[71500]:   <features>
Apr 14 16:18:29 user nova-compute[71500]:     <acpi/>
Apr 14 16:18:29 user nova-compute[71500]:     <apic/>
Apr 14 16:18:29 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:18:29 user nova-compute[71500]:   </features>
Apr 14 16:18:29 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:18:29 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:18:29 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:18:29 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:18:29 user nova-compute[71500]:   </clock>
Apr 14 16:18:29 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:18:29 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:18:29 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:18:29 user nova-compute[71500]:   </cpu>
Apr 14 16:18:29 user nova-compute[71500]:   <devices>
Apr 14 16:18:29 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:18:29 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:18:29 user nova-compute[71500]:       <source dev="/dev/sdc"/>
Apr 14 16:18:29 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:18:29 user nova-compute[71500]:       <serial>0e034314-7a16-475b-a993-e56064a2f916</serial>
Apr 14 16:18:29 user nova-compute[71500]:     </disk>
Apr 14 16:18:29 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:18:29 user nova-compute[71500]:       <mac address="fa:16:3e:44:7f:09"/>
Apr 14 16:18:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:18:29 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:18:29 user nova-compute[71500]:       <target dev="tapac9e2d3b-e9"/>
Apr 14 16:18:29 user nova-compute[71500]:     </interface>
Apr 14 16:18:29 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:18:29 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/8f8afdbf-f148-4447-a480-dbbb17fc45ea/console.log" append="off"/>
Apr 14 16:18:29 user nova-compute[71500]:     </serial>
Apr 14 16:18:29 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:18:29 user nova-compute[71500]:     <video>
Apr 14 16:18:29 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:18:29 user nova-compute[71500]:     </video>
Apr 14 16:18:29 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:18:29 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:18:29 user nova-compute[71500]:     </rng>
Apr 14 16:18:29 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:18:29 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:18:29 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:18:29 user nova-compute[71500]:     </memballoon>
Apr 14 16:18:29 user nova-compute[71500]:   </devices>
Apr 14 16:18:29 user nova-compute[71500]: </domain>
Apr 14 16:18:29 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1337435188',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1337435188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1337435188',id=42,image_ref='0e4f659b-d29c-4f4f-b2df-b08af690bed4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-04cygcb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1344751469',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:18:18Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=8f8afdbf-f148-4447-a480-dbbb17fc45ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG os_vif [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac9e2d3b-e9, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac9e2d3b-e9, col_values=(('external_ids', {'iface-id': 'ac9e2d3b-e929-4fac-b9ae-8af8aa53b465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:7f:09', 'vm-uuid': '8f8afdbf-f148-4447-a480-dbbb17fc45ea'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:29 user nova-compute[71500]: INFO os_vif [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9')
Apr 14 16:18:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:18:30 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No VIF found with MAC fa:16:3e:44:7f:09, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:18:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updated VIF entry in instance network info cache for port 45b6be70-59dc-4cbe-a5c9-9a6feab419cf. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:18:30 user nova-compute[71500]: DEBUG nova.network.neutron [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updating instance_info_cache with network_info: [{"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:18:30 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-ea19ed80-7df6-4047-a4cc-7effde51908f req-29c8deb9-98d4-4646-a769-5d57c535f653 service nova] Releasing lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] No waiting events found dispatching network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:18:32 user nova-compute[71500]: WARNING nova.compute.manager [req-16b27579-d0e2-40be-bf2a-5eb6f163296c req-d9e2ab4e-d58b-4bec-be3b-a73c359141e1 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received unexpected event network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance with vm_state building and task_state spawning.
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:32 user nova-compute[71500]: DEBUG nova.compute.manager [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] No waiting events found dispatching network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:18:32 user nova-compute[71500]: WARNING nova.compute.manager [req-32f21d0a-44c4-4bb1-a7a4-33dc1fa81bba req-2f2a6747-2f4e-467c-ae82-8ab8bd63dc45 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received unexpected event network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance with vm_state building and task_state spawning.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] No waiting events found dispatching network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:18:34 user nova-compute[71500]: WARNING nova.compute.manager [req-48663320-50a2-400b-a3c4-d5b4c029068d req-76ad0e5b-a2e6-470c-ae8f-8e9ef9cdb37b service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received unexpected event network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance with vm_state building and task_state spawning.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] No waiting events found dispatching network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:18:34 user nova-compute[71500]: WARNING nova.compute.manager [req-7cb895dd-5650-4e86-9f2a-a54eb40b8c68 req-a06e80ed-2a5e-4de1-8055-7a807db2f9ac service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received unexpected event network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance with vm_state building and task_state spawning.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489114.7943487, 8f8afdbf-f148-4447-a480-dbbb17fc45ea => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] VM Resumed (Lifecycle Event)
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Instance spawned successfully.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Instance spawned successfully.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489114.7982373, 8f8afdbf-f148-4447-a480-dbbb17fc45ea => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] VM Started (Lifecycle Event)
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Took 6.39 seconds to spawn the instance on the hypervisor.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:18:34 user nova-compute[71500]: INFO nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Took 7.06 seconds to spawn the instance on the hypervisor.
Apr 14 16:18:34 user nova-compute[71500]: DEBUG nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:18:35 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:18:35 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489114.8241732, 7d0b5baa-3cec-4162-b27e-fa2665134f2a => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:18:35 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] VM Resumed (Lifecycle Event)
Apr 14 16:18:35 user nova-compute[71500]: INFO nova.compute.manager [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Took 17.71 seconds to build instance.
Apr 14 16:18:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:18:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c47d14e0-1d16-463d-b55c-4f248159bd6e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.817s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:35 user nova-compute[71500]: INFO nova.compute.manager [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Took 7.62 seconds to build instance.
Apr 14 16:18:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:18:35 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-9da8ab1f-3d0c-44f8-8b8e-df83483ef099 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.723s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:18:35 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489114.828685, 7d0b5baa-3cec-4162-b27e-fa2665134f2a => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:18:35 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] VM Started (Lifecycle Event)
Apr 14 16:18:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:18:35 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:18:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:18:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:18:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:18:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:18:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:18:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 375e1073-5299-4d9d-8100-6f626e4bf122 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating instance_info_cache with network_info: [{"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-375e1073-5299-4d9d-8100-6f626e4bf122" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:19:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:19:07 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:19:07 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=26.068050384521484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 375e1073-5299-4d9d-8100-6f626e4bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:19:07 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:19:08 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:19:08 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:19:08 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:19:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:10 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:19:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:19:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:30 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:19:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:19:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:19:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:19:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:19:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:20:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:20:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:20:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:20:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:20:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:20:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:20:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:20:05 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:07 user nova-compute[71500]: INFO nova.compute.manager [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Terminating instance
Apr 14 16:20:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-vif-unplugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] No waiting events found dispatching network-vif-unplugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:20:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-8ce90ea2-0125-4698-854d-742d57f8cbf2 req-90cc1f1b-531d-4256-93b0-c213fd4ef12c service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-vif-unplugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Skipping network cache update for instance because it is being deleted. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Instance destroyed successfully.
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.objects.instance [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'resources' on Instance uuid 8f8afdbf-f148-4447-a480-dbbb17fc45ea {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:18:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1337435188',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1337435188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1337435188',id=42,image_ref='0e4f659b-d29c-4f4f-b2df-b08af690bed4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-04cygcb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1344751469',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:18:35Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=8f8afdbf-f148-4447-a480-dbbb17fc45ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "address": "fa:16:3e:44:7f:09", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac9e2d3b-e9", "ovs_interfaceid": "ac9e2d3b-e929-4fac-b9ae-8af8aa53b465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_vif [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac9e2d3b-e9, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:20:08 user nova-compute[71500]: INFO os_vif [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:7f:09,bridge_name='br-int',has_traffic_filtering=True,id=ac9e2d3b-e929-4fac-b9ae-8af8aa53b465,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac9e2d3b-e9')
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ekDUuRzH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:20:08 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522e6d0-8ba2-4c5e-b8e7-c373f1a10462]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:20:08 user nova-compute[71500]: No targets found.
Apr 14 16:20:08 user nova-compute[71500]: iSNS:
Apr 14 16:20:08 user nova-compute[71500]: No targets found.
Apr 14 16:20:08 user nova-compute[71500]: STATIC:
Apr 14 16:20:08 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020
Apr 14 16:20:08 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:20:08 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:20:08 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916
Apr 14 16:20:08 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:20:08 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:20:08 user nova-compute[71500]: FIRMWARE:
Apr 14 16:20:08 user nova-compute[71500]: No targets found.
Apr 14 16:20:08 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:20:08 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:20:08 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e036d52-79c3-4fd7-9086-eaa98c7cf1fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57c1a8-0e63-4e3e-ab26-980d57e00abc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:08 user nova-compute[71500]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 (non-flash)
Apr 14 16:20:08 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:08 user nova-compute[71500]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 (non-flash)
Apr 14 16:20:08 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0202e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bf9176-d910-4a83-a96e-26bc64cffbc7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b164cd-27f6-4ee8-89ab-944384828f86]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b036f5e2-e8a7-4238-b3b8-cd0b8896d4b5]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c159f8-5bc1-47c1-89c0-7d3378070fe7]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23434353336616330', '/dev/disk/by-id/scsi-1SCST_BIOd268fd74-44536ac04273ae8f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d268fd74') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b1563-ca2a-4e78-8312-07d368dac1c8]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7338e88f-2805-42fe-a816-35654e40ea69]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb19353a-e193-4132-b413-0fdc2a3188ef]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260]
Apr 14 16:20:08 user nova-compute[71500]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916, portal: 172.16.0.220,3260] successful.
Apr 14 16:20:08 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e034314-7a16-475b-a993-e56064a2f916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5594b112-5f82-460a-80c4-dc0402e76ac3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== disconnect_volume: return (324ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:20:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Deleting instance files /opt/stack/data/nova/instances/8f8afdbf-f148-4447-a480-dbbb17fc45ea_del
Apr 14 16:20:08 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Deletion of /opt/stack/data/nova/instances/8f8afdbf-f148-4447-a480-dbbb17fc45ea_del complete
Apr 14 16:20:08 user nova-compute[71500]: INFO nova.compute.manager [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updating instance_info_cache with network_info: [{"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-7d0b5baa-3cec-4162-b27e-fa2665134f2a" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:20:08 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:20:09 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Took 0.55 seconds to deallocate network for instance.
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.manager [req-9802c4db-29cb-4526-8b60-388743fce42d req-c0ac85eb-acce-428b-8678-4e80557f8bb0 service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-vif-deleted-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:20:09 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:20:09 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=26.067352294921875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 375e1073-5299-4d9d-8100-6f626e4bf122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:20:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received event network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Acquiring lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] No waiting events found dispatching network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:20:10 user nova-compute[71500]: WARNING nova.compute.manager [req-f0cf1024-95a0-4586-a7be-a0ec0bb8af17 req-d51036b6-2bc6-4abf-97fb-0765e46c324c service nova] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Received unexpected event network-vif-plugged-ac9e2d3b-e929-4fac-b9ae-8af8aa53b465 for instance with vm_state active and task_state deleting.
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:10 user nova-compute[71500]: INFO nova.compute.manager [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Took 0.85 seconds to detach 1 volumes for instance.
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Deleting volume: 0e034314-7a16-475b-a993-e56064a2f916 {{(pid=71500) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:10 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Deleted allocations for instance 8f8afdbf-f148-4447-a480-dbbb17fc45ea
Apr 14 16:20:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-3c6acd84-7d32-42b9-8480-0252b884f4be tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "8f8afdbf-f148-4447-a480-dbbb17fc45ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:20:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG nova.objects.instance [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'flavor' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:20:17 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Ignoring supplied device name: /dev/vdb
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:17 user nova-compute[71500]: INFO nova.compute.manager [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Attaching volume eeb99511-2a0c-4628-91f6-22da52882de4 to /dev/vdb
Apr 14 16:20:17 user nova-compute[71500]: DEBUG os_brick.utils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[66855fc9-cb17-4e9b-a842-4e918a4432e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4668a014-9abe-45f6-9f23-d46d1cfe3a32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bcb010-7422-431e-a657-6a1499f92131]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0572b38e-77ae-4bd4-aeeb-91de2c9f5454]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:20:17 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:20:17 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a2e7dc-1ca5-4fb5-b104-bfabb34bf07a]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG os_brick.utils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:20:17 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updating existing volume attachment record: 1d6993b1-a9b7-4563-ad02-05d4ead9845c {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:20:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXhLEpzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:20:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:20:22 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:20:22 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a485db7c-3d13-4787-b132-9e3e419e9c5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:20:22 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4755d5-c3fd-49ee-a235-f006990c63e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4] added
Apr 14 16:20:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf17b24-7853-4653-a385-4e3b45c764dd]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad49cd-d20b-4952-9f76-337782b44ce8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXhLEpzT {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXhLEpzT" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8169013c-c211-47f6-8cd8-ded71a371ff7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXhLEpzT'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf46d2ac-4bef-41db-9d13-13eeb11335d4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c41d0d4-176d-4b43-a540-313ceade67db]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c12a63-b7c2-48b3-b1da-ee7fae6d35dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260]
Apr 14 16:20:22 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260] successful.
Apr 14 16:20:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ff7d6f-2e0f-4ce4-a335-59b4e8deb4e0]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b285bc40-006d-4dac-be44-74f604224393]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:22 user nova-compute[71500]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 (non-flash)
Apr 14 16:20:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:22 user nova-compute[71500]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 (non-flash)
Apr 14 16:20:22 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[750fe3f9-9bad-46da-a33b-9d1973188c54]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:20:22 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXhLEpzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489208.4669244, 8f8afdbf-f148-4447-a480-dbbb17fc45ea => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:20:23 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] VM Stopped (Lifecycle Event)
Apr 14 16:20:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-15c39e5c-e959-4119-809a-0d7e09dfcde4 None None] [instance: 8f8afdbf-f148-4447-a480-dbbb17fc45ea] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23363323764643032', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363323764643032', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG nova.objects.instance [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'flavor' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:20:23 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 16:20:23 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:20:23 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:20:23 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:20:23 user nova-compute[71500]:   <serial>eeb99511-2a0c-4628-91f6-22da52882de4</serial>
Apr 14 16:20:23 user nova-compute[71500]: </disk>
Apr 14 16:20:23 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 16:20:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:20:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:20:24 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No VIF found with MAC fa:16:3e:c8:b8:c9, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:20:24 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-65471fa4-cbc6-4fa6-ad04-5315673e3862 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.488s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:20:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:20:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:20:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:20:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:45 user nova-compute[71500]: INFO nova.compute.manager [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Detaching volume eeb99511-2a0c-4628-91f6-22da52882de4
Apr 14 16:20:45 user nova-compute[71500]: INFO nova.virt.block_device [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Attempting to driver detach volume eeb99511-2a0c-4628-91f6-22da52882de4 from mountpoint /dev/vdb
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Attempting to detach device vdb from instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:20:45 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:20:45 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:20:45 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:20:45 user nova-compute[71500]:   <serial>eeb99511-2a0c-4628-91f6-22da52882de4</serial>
Apr 14 16:20:45 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:20:45 user nova-compute[71500]: </disk>
Apr 14 16:20:45 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:20:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully detached device vdb from instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a from the persistent domain config.
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:20:45 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:20:45 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:20:45 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:20:45 user nova-compute[71500]:   <serial>eeb99511-2a0c-4628-91f6-22da52882de4</serial>
Apr 14 16:20:45 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:20:45 user nova-compute[71500]: </disk>
Apr 14 16:20:45 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681489245.6306958, 7d0b5baa-3cec-4162-b27e-fa2665134f2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 16:20:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully detached device vdb from instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a from the live domain config.
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXhLEpzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:20:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fefa0ff-35dd-4782-a215-41875b4a33d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:20:45 user nova-compute[71500]: No targets found.
Apr 14 16:20:45 user nova-compute[71500]: iSNS:
Apr 14 16:20:45 user nova-compute[71500]: No targets found.
Apr 14 16:20:45 user nova-compute[71500]: STATIC:
Apr 14 16:20:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020
Apr 14 16:20:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:20:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:20:45 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4
Apr 14 16:20:45 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:20:45 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:20:45 user nova-compute[71500]: FIRMWARE:
Apr 14 16:20:45 user nova-compute[71500]: No targets found.
Apr 14 16:20:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:20:45 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:20:45 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2f806a-a77c-410c-8059-c161bef3483a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af5392-9686-4485-866c-bf4c5f1000f5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:45 user nova-compute[71500]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 (non-flash)
Apr 14 16:20:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:45 user nova-compute[71500]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 (non-flash)
Apr 14 16:20:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0204d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ff404-da5b-4bac-b89e-8dc5167db9dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[278233e6-784c-43d8-8d5f-9b54f995f66f]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c68591d-1326-43de-960b-92ad87ed6abc]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[136dd40b-e940-4a93-b33f-b8a29ec1d203]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[97beefd9-3682-4be0-a41d-1344cb12b872]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1998dc83-baeb-4944-9e9b-52167b4425e8]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260]
Apr 14 16:20:45 user nova-compute[71500]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4, portal: 172.16.0.220,3260] successful.
Apr 14 16:20:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[36381a5a-ca6b-4e9f-9753-a4c323b037ac]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== disconnect_volume: return (300ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:20:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'flavor' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-62c3cd8d-28a7-42c6-b1fa-432f93902237 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.707s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.590s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:46 user nova-compute[71500]: INFO nova.compute.manager [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Terminating instance
Apr 14 16:20:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-vif-unplugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] No waiting events found dispatching network-vif-unplugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:20:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-3af652ae-997b-4811-8d83-87cc5196a86f req-afa240af-4325-45cb-b72e-f85225cce4f8 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-vif-unplugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:20:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Instance destroyed successfully.
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'resources' on Instance uuid 7d0b5baa-3cec-4162-b27e-fa2665134f2a {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:18:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1886734098',display_name='tempest-VolumesSnapshotTestJSON-instance-1886734098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1886734098',id=43,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e78327b280e74412bd43a54a522c20d0',ramdisk_id='',reservation_id='r-i44mopzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1091655053',owner_user_name='tempest-VolumesSnapshotTestJSON-1091655053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:18:35Z,user_data=None,user_id='ffdaf3dc40b0445ea03d2f69abd46924',uuid=7d0b5baa-3cec-4162-b27e-fa2665134f2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converting VIF {"id": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "address": "fa:16:3e:c8:b8:c9", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45b6be70-59", "ovs_interfaceid": "45b6be70-59dc-4cbe-a5c9-9a6feab419cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_vif [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45b6be70-59, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:20:47 user nova-compute[71500]: INFO os_vif [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:b8:c9,bridge_name='br-int',has_traffic_filtering=True,id=45b6be70-59dc-4cbe-a5c9-9a6feab419cf,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45b6be70-59')
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXhLEpzT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:20:47 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bcfa97-4635-469d-b979-affbe0106742]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:20:47 user nova-compute[71500]: No targets found.
Apr 14 16:20:47 user nova-compute[71500]: iSNS:
Apr 14 16:20:47 user nova-compute[71500]: No targets found.
Apr 14 16:20:47 user nova-compute[71500]: STATIC:
Apr 14 16:20:47 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020
Apr 14 16:20:47 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:20:47 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:20:47 user nova-compute[71500]: FIRMWARE:
Apr 14 16:20:47 user nova-compute[71500]: No targets found.
Apr 14 16:20:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:20:47 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:20:47 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeb99511-2a0c-4628-91f6-22da52882de4', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a87ca-b666-47d5-bea6-66c607461fc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d820119-9840-40b4-a43e-0db024d035c9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:20:47 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7faddc18c700>, {}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Disconnecting from: [] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== disconnect_volume: return (65ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:20:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Deleting instance files /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a_del
Apr 14 16:20:47 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Deletion of /opt/stack/data/nova/instances/7d0b5baa-3cec-4162-b27e-fa2665134f2a_del complete
Apr 14 16:20:47 user nova-compute[71500]: INFO nova.compute.manager [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 16:20:47 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:20:47 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:20:48 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:20:48 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Took 0.72 seconds to deallocate network for instance.
Apr 14 16:20:48 user nova-compute[71500]: WARNING nova.volume.cinder [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Attachment 1d6993b1-a9b7-4563-ad02-05d4ead9845c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1d6993b1-a9b7-4563-ad02-05d4ead9845c. (HTTP 404) (Request-ID: req-9df2f020-2a33-4471-af6d-be1c7d786de0)
Apr 14 16:20:48 user nova-compute[71500]: INFO nova.compute.manager [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 16:20:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:48 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:20:48 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:20:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:48 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Deleted allocations for instance 7d0b5baa-3cec-4162-b27e-fa2665134f2a
Apr 14 16:20:48 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ccac4396-c836-44d0-bf90-3de5f6bc09f4 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.997s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:20:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Acquiring lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:20:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:20:49 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] Lock "7d0b5baa-3cec-4162-b27e-fa2665134f2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:20:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] No waiting events found dispatching network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:20:49 user nova-compute[71500]: WARNING nova.compute.manager [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received unexpected event network-vif-plugged-45b6be70-59dc-4cbe-a5c9-9a6feab419cf for instance with vm_state deleted and task_state None.
Apr 14 16:20:49 user nova-compute[71500]: DEBUG nova.compute.manager [req-269a6837-4b8e-4703-aa81-6ef8763dc99d req-f748fc4a-e2fd-4685-a4d4-3599026860e9 service nova] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Received event network-vif-deleted-45b6be70-59dc-4cbe-a5c9-9a6feab419cf {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:20:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:20:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "375e1073-5299-4d9d-8100-6f626e4bf122" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:02 user nova-compute[71500]: INFO nova.compute.manager [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Terminating instance
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-vif-unplugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] No waiting events found dispatching network-vif-unplugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.compute.manager [req-1947628b-a202-4a9d-a417-b851584df229 req-cb624f5c-8973-4d8d-ae81-38d142644e10 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-vif-unplugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489247.5175617, 7d0b5baa-3cec-4162-b27e-fa2665134f2a => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:21:02 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] VM Stopped (Lifecycle Event)
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.compute.manager [None req-0f6a53b5-be6b-4b83-b029-bdaebdb67883 None None] [instance: 7d0b5baa-3cec-4162-b27e-fa2665134f2a] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Instance destroyed successfully.
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'resources' on Instance uuid 375e1073-5299-4d9d-8100-6f626e4bf122 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-345674687',display_name='tempest-TestVolumeBootPattern-volume-backed-server-345674687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-345674687',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:16:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-r7n6r89k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:16:33Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=375e1073-5299-4d9d-8100-6f626e4bf122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "address": "fa:16:3e:1e:9a:c3", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83d0ffe-90", "ovs_interfaceid": "c83d0ffe-900d-4f39-bd31-2db21e0870f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_vif [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83d0ffe-90, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:02 user nova-compute[71500]: INFO os_vif [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=c83d0ffe-900d-4f39-bd31-2db21e0870f7,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83d0ffe-90')
Apr 14 16:21:02 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbsEUkTe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:21:02 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cbfbaf-5a70-4ec3-a5a3-f24f84d4d26d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:21:02 user nova-compute[71500]: No targets found.
Apr 14 16:21:02 user nova-compute[71500]: iSNS:
Apr 14 16:21:02 user nova-compute[71500]: No targets found.
Apr 14 16:21:02 user nova-compute[71500]: STATIC:
Apr 14 16:21:02 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020
Apr 14 16:21:02 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:21:02 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:21:02 user nova-compute[71500]: FIRMWARE:
Apr 14 16:21:02 user nova-compute[71500]: No targets found.
Apr 14 16:21:02 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:21:02 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:21:02 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e837f9-db0b-4664-8747-e2e70e73b646]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f320928-edfb-4646-b2a1-0dfa70cd3dd5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:21:02 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 (non-flash)
Apr 14 16:21:02 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc4d5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd479f5e-b316-47d8-96c9-c086c1321767]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2beea5-d9f8-488e-b0b3-2c8d58b2ed78]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe43fa-9b14-4e37-802b-b66226b9ca98]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:21:02 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.152s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb3330-e5fe-4666-b3fc-a9c29bdc89f4]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2c87fe1-9287fd9cfdf0edf1', '/dev/disk/by-id/scsi-23932383766643963', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c87fe1') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c445fe0c-44c8-47c3-ac4c-f4074d3074ef]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd95b046-7e64-4cfd-b976-e47bd8e25baf]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --logout" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2330bf6-1215-4879-9926-a7c951bb31e2]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260]
Apr 14 16:21:03 user nova-compute[71500]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020, portal: 172.16.0.220,3260] successful.
Apr 14 16:21:03 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ded1e85d-494f-490d-9ddc-7d7b9bc8c020 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[512ec225-09b6-49ab-a1f2-47821bb24d1d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== disconnect_volume: return (366ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:21:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Deleting instance files /opt/stack/data/nova/instances/375e1073-5299-4d9d-8100-6f626e4bf122_del
Apr 14 16:21:03 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Deletion of /opt/stack/data/nova/instances/375e1073-5299-4d9d-8100-6f626e4bf122_del complete
Apr 14 16:21:03 user nova-compute[71500]: INFO nova.compute.manager [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 16:21:03 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:21:03 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:21:03 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Took 0.63 seconds to deallocate network for instance.
Apr 14 16:21:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Acquiring lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] Lock "375e1073-5299-4d9d-8100-6f626e4bf122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] No waiting events found dispatching network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:21:04 user nova-compute[71500]: WARNING nova.compute.manager [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received unexpected event network-vif-plugged-c83d0ffe-900d-4f39-bd31-2db21e0870f7 for instance with vm_state active and task_state deleting.
Apr 14 16:21:04 user nova-compute[71500]: DEBUG nova.compute.manager [req-cfc7a217-c5d5-4ec9-8174-bdb68a355e10 req-6185241e-f43a-4e9a-beca-a88a38017a95 service nova] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Received event network-vif-deleted-c83d0ffe-900d-4f39-bd31-2db21e0870f7 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:21:04 user nova-compute[71500]: INFO nova.compute.manager [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 16:21:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Deleting volume: ded1e85d-494f-490d-9ddc-7d7b9bc8c020 {{(pid=71500) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:21:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:05 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Deleted allocations for instance 375e1073-5299-4d9d-8100-6f626e4bf122
Apr 14 16:21:05 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d2e18f1a-47fb-43c2-a77b-5d6e6a0f619e tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "375e1073-5299-4d9d-8100-6f626e4bf122" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.045s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:08 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:21:09 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:21:09 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=26.084121704101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:21:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:10 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:21:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:21:10 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 16:21:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:21:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:17 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489262.7765248, 375e1073-5299-4d9d-8100-6f626e4bf122 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:21:17 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] VM Stopped (Lifecycle Event)
Apr 14 16:21:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-cb3af567-35b5-439f-90ba-4fe00f999c63 None None] [instance: 375e1073-5299-4d9d-8100-6f626e4bf122] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:21:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:21 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:21:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:21:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:21:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:21:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:21:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:21:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:21:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:21:50 user nova-compute[71500]: INFO nova.compute.claims [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Claim successful on node user
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:21:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.policy [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffdaf3dc40b0445ea03d2f69abd46924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78327b280e74412bd43a54a522c20d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:21:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Creating image(s)
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "/opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "/opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "/opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk 1073741824 {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0,backing_fmt=raw /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk 1073741824" returned: 0 in 0.049s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "f0eec9d75765900d3d94f3c181e1f1ef34d82ca0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0eec9d75765900d3d94f3c181e1f1ef34d82ca0 --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk. size=1073741824 {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Successfully created port: a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG nova.virt.disk.api [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Cannot resize image /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk to a smaller size. {{(pid=71500) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'migration_context' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Created local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Ensure instance console log exists: /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Successfully updated port: a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquired lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-changed-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Refreshing instance network info cache due to event network-changed-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Acquiring lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.neutron [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updating instance_info_cache with network_info: [{"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Releasing lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Instance network_info: |[{"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Acquired lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Refreshing network info cache for port a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Start _get_guest_xml network_info=[{"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encryption_options': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'image_id': 'e3a0daa8-78ae-44af-8756-1fad21c352f3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:21:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:21:52 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T15:32:52Z,direct_url=<?>,disk_format='qcow2',id=e3a0daa8-78ae-44af-8756-1fad21c352f3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='50e41ae46e6146588368020524d2d409',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T15:32:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-917436846',display_name='tempest-VolumesSnapshotTestJSON-instance-917436846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-917436846',id=44,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78327b280e74412bd43a54a522c20d0',ramdisk_id='',reservation_id='r-xwydzqpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1091655053',owner_user_name='tempest-VolumesSnapshotTestJSON-1091655053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:21:51Z,user_data=None,user_id='ffdaf3dc40b0445ea03d2f69abd46924',uuid=0643d79c-19ea-44b2-888b-537717701f72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converting VIF {"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'pci_devices' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:21:52 user nova-compute[71500]:   <uuid>0643d79c-19ea-44b2-888b-537717701f72</uuid>
Apr 14 16:21:52 user nova-compute[71500]:   <name>instance-0000002c</name>
Apr 14 16:21:52 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:21:52 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:21:52 user nova-compute[71500]:   <metadata>
Apr 14 16:21:52 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:21:52 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:21:52 user nova-compute[71500]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-917436846</nova:name>
Apr 14 16:21:52 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:21:52</nova:creationTime>
Apr 14 16:21:52 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:21:52 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:21:52 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:21:52 user nova-compute[71500]:       <nova:owner>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:user uuid="ffdaf3dc40b0445ea03d2f69abd46924">tempest-VolumesSnapshotTestJSON-1091655053-project-member</nova:user>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:project uuid="e78327b280e74412bd43a54a522c20d0">tempest-VolumesSnapshotTestJSON-1091655053</nova:project>
Apr 14 16:21:52 user nova-compute[71500]:       </nova:owner>
Apr 14 16:21:52 user nova-compute[71500]:       <nova:root type="image" uuid="e3a0daa8-78ae-44af-8756-1fad21c352f3"/>
Apr 14 16:21:52 user nova-compute[71500]:       <nova:ports>
Apr 14 16:21:52 user nova-compute[71500]:         <nova:port uuid="a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27">
Apr 14 16:21:52 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 16:21:52 user nova-compute[71500]:         </nova:port>
Apr 14 16:21:52 user nova-compute[71500]:       </nova:ports>
Apr 14 16:21:52 user nova-compute[71500]:     </nova:instance>
Apr 14 16:21:52 user nova-compute[71500]:   </metadata>
Apr 14 16:21:52 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:21:52 user nova-compute[71500]:     <system>
Apr 14 16:21:52 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:21:52 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:21:52 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:21:52 user nova-compute[71500]:       <entry name="serial">0643d79c-19ea-44b2-888b-537717701f72</entry>
Apr 14 16:21:52 user nova-compute[71500]:       <entry name="uuid">0643d79c-19ea-44b2-888b-537717701f72</entry>
Apr 14 16:21:52 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:21:52 user nova-compute[71500]:     </system>
Apr 14 16:21:52 user nova-compute[71500]:   </sysinfo>
Apr 14 16:21:52 user nova-compute[71500]:   <os>
Apr 14 16:21:52 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:21:52 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:21:52 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:21:52 user nova-compute[71500]:   </os>
Apr 14 16:21:52 user nova-compute[71500]:   <features>
Apr 14 16:21:52 user nova-compute[71500]:     <acpi/>
Apr 14 16:21:52 user nova-compute[71500]:     <apic/>
Apr 14 16:21:52 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:21:52 user nova-compute[71500]:   </features>
Apr 14 16:21:52 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:21:52 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:21:52 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:21:52 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:21:52 user nova-compute[71500]:   </clock>
Apr 14 16:21:52 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:21:52 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:21:52 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:21:52 user nova-compute[71500]:   </cpu>
Apr 14 16:21:52 user nova-compute[71500]:   <devices>
Apr 14 16:21:52 user nova-compute[71500]:     <disk type="file" device="disk">
Apr 14 16:21:52 user nova-compute[71500]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 16:21:52 user nova-compute[71500]:       <source file="/opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk"/>
Apr 14 16:21:52 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:21:52 user nova-compute[71500]:     </disk>
Apr 14 16:21:52 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:21:52 user nova-compute[71500]:       <mac address="fa:16:3e:3a:22:d3"/>
Apr 14 16:21:52 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:21:52 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:21:52 user nova-compute[71500]:       <target dev="tapa56f6dba-69"/>
Apr 14 16:21:52 user nova-compute[71500]:     </interface>
Apr 14 16:21:52 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:21:52 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/console.log" append="off"/>
Apr 14 16:21:52 user nova-compute[71500]:     </serial>
Apr 14 16:21:52 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:21:52 user nova-compute[71500]:     <video>
Apr 14 16:21:52 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:21:52 user nova-compute[71500]:     </video>
Apr 14 16:21:52 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:21:52 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:21:52 user nova-compute[71500]:     </rng>
Apr 14 16:21:52 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:21:52 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:21:52 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:21:52 user nova-compute[71500]:     </memballoon>
Apr 14 16:21:52 user nova-compute[71500]:   </devices>
Apr 14 16:21:52 user nova-compute[71500]: </domain>
Apr 14 16:21:52 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-917436846',display_name='tempest-VolumesSnapshotTestJSON-instance-917436846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-917436846',id=44,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e78327b280e74412bd43a54a522c20d0',ramdisk_id='',reservation_id='r-xwydzqpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1091655053',owner_user_name='tempest-VolumesSnapshotTestJSON-1091655053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:21:51Z,user_data=None,user_id='ffdaf3dc40b0445ea03d2f69abd46924',uuid=0643d79c-19ea-44b2-888b-537717701f72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converting VIF {"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG os_vif [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa56f6dba-69, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa56f6dba-69, col_values=(('external_ids', {'iface-id': 'a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:22:d3', 'vm-uuid': '0643d79c-19ea-44b2-888b-537717701f72'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:52 user nova-compute[71500]: INFO os_vif [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69')
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:21:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No VIF found with MAC fa:16:3e:3a:22:d3, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:21:53 user nova-compute[71500]: DEBUG nova.network.neutron [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updated VIF entry in instance network info cache for port a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:21:53 user nova-compute[71500]: DEBUG nova.network.neutron [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updating instance_info_cache with network_info: [{"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:21:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3b0c878b-e70e-4f16-af6c-9f01e6c6769a req-e546fd9e-605c-4028-b9a9-b2185ca1f679 service nova] Releasing lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] No waiting events found dispatching network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:21:54 user nova-compute[71500]: WARNING nova.compute.manager [req-81bde587-cc93-4432-a8c8-cdac738e2f05 req-45c7dc61-af85-49e7-9225-578422bc3332 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received unexpected event network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance with vm_state building and task_state spawning.
Apr 14 16:21:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] No waiting events found dispatching network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:21:56 user nova-compute[71500]: WARNING nova.compute.manager [req-97d89d18-d208-4bf4-bff1-556bb85be90a req-19a711d4-f877-46a4-98f6-0251c233bef1 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received unexpected event network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance with vm_state building and task_state spawning.
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489316.2575903, 0643d79c-19ea-44b2-888b-537717701f72 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] VM Resumed (Lifecycle Event)
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Instance spawned successfully.
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489316.2635026, 0643d79c-19ea-44b2-888b-537717701f72 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] VM Started (Lifecycle Event)
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Took 5.68 seconds to spawn the instance on the hypervisor.
Apr 14 16:21:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:21:56 user nova-compute[71500]: INFO nova.compute.manager [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Took 6.18 seconds to build instance.
Apr 14 16:21:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2489f360-6345-4a42-93a6-485b7e05b1f9 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.278s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:21:59 user nova-compute[71500]: INFO nova.compute.claims [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Claim successful on node user
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:21:59 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:21:59 user nova-compute[71500]: DEBUG nova.policy [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:21:59 user nova-compute[71500]: INFO nova.virt.block_device [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Booting with volume 14e6cb90-ca04-4130-8635-ab2c3243bd5e at /dev/vda
Apr 14 16:22:00 user nova-compute[71500]: DEBUG os_brick.utils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ede45-f7c9-47bf-8134-c47e8ce624fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9921c918-23b7-471a-9c0d-123570c9baa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5716e7-b8a3-4c5b-9001-2a02fc2ab127]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8625e216-6a23-47ec-8afc-346bee6a03ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:22:00 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:22:00 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d35a0-466f-4187-beca-e19394cdebea]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG os_brick.utils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updating existing volume attachment record: 17397ab6-aa88-4bbb-b071-4058c932b69f {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:22:00 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Successfully created port: 2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Successfully updated port: 2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquired lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-changed-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.compute.manager [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Refreshing instance network info cache due to event network-changed-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Acquiring lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.network.neutron [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updating instance_info_cache with network_info: [{"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Releasing lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Instance network_info: |[{"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Acquired lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:22:01 user nova-compute[71500]: DEBUG nova.network.neutron [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Refreshing network info cache for port 2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:22:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updated VIF entry in instance network info cache for port 2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:22:02 user nova-compute[71500]: DEBUG nova.network.neutron [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updating instance_info_cache with network_info: [{"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:22:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:22:02 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-f19848e8-a20e-469a-b792-0ad7a44eda1b req-813ab0c5-77d2-4654-a26e-cea82cb09197 service nova] Releasing lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:22:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Creating image(s)
Apr 14 16:22:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Ensure instance console log exists: /opt/stack/data/nova/instances/20a0fd5f-afbb-42ca-be41-0d18535241b3/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:22:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Start _get_guest_xml network_info=[{"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '17397ab6-aa88-4bbb-b071-4058c932b69f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20a0fd5f-afbb-42ca-be41-0d18535241b3', 'attached_at': '', 'detached_at': '', 'volume_id': '14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'serial': '14e6cb90-ca04-4130-8635-ab2c3243bd5e'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:22:04 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:22:04 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:22:05 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:22:05 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:22:05 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f7de7-3388-4374-b7db-c50494e87941]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:22:05 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca82c57-154b-40ad-b5d3-96c1174b838a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e] added
Apr 14 16:22:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66be096-1064-43f7-aeef-1f6a3e86efef]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4863a3c1-17c9-438c-a577-d140f3e4a732]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqZCnTr {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqZCnTr" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[346301e0-9fbb-4074-b360-f512978f357e]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtqZCnTr'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8da4a0-317c-4b3a-88e5-21765e7982f6]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d5eb0-a6e2-47a4-b1a1-39aa094546a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:22:05 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:22:05 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:22:05 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:22:05 user nova-compute[71500]: 
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f5df7-3608-4244-a08d-69f51d1431b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]
Apr 14 16:22:05 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.
Apr 14 16:22:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c53438-6bad-4b00-be7f-bc76c6d1b0d7]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf2eba7-3d4c-44f1-af7b-432fa98271d7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:22:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:22:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[022d493c-48dc-4a3d-b75b-451a130d5b32]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:22:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23537653562356435', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653562356435', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-539389530',display_name='tempest-TestVolumeBootPattern-server-539389530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-539389530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-u12fpd4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:22:00Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=20a0fd5f-afbb-42ca-be41-0d18535241b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'pci_devices' on Instance uuid 20a0fd5f-afbb-42ca-be41-0d18535241b3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:22:06 user nova-compute[71500]:   <uuid>20a0fd5f-afbb-42ca-be41-0d18535241b3</uuid>
Apr 14 16:22:06 user nova-compute[71500]:   <name>instance-0000002d</name>
Apr 14 16:22:06 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:22:06 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:22:06 user nova-compute[71500]:   <metadata>
Apr 14 16:22:06 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:22:06 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:22:06 user nova-compute[71500]:       <nova:name>tempest-TestVolumeBootPattern-server-539389530</nova:name>
Apr 14 16:22:06 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:22:04</nova:creationTime>
Apr 14 16:22:06 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:22:06 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:22:06 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:22:06 user nova-compute[71500]:       <nova:owner>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:user uuid="bb3b7ae19e044c3e90292751dd633279">tempest-TestVolumeBootPattern-1344751469-project-member</nova:user>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:project uuid="2ffc20a7a2f44e5cafb12334ea4230eb">tempest-TestVolumeBootPattern-1344751469</nova:project>
Apr 14 16:22:06 user nova-compute[71500]:       </nova:owner>
Apr 14 16:22:06 user nova-compute[71500]:       <nova:ports>
Apr 14 16:22:06 user nova-compute[71500]:         <nova:port uuid="2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24">
Apr 14 16:22:06 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 16:22:06 user nova-compute[71500]:         </nova:port>
Apr 14 16:22:06 user nova-compute[71500]:       </nova:ports>
Apr 14 16:22:06 user nova-compute[71500]:     </nova:instance>
Apr 14 16:22:06 user nova-compute[71500]:   </metadata>
Apr 14 16:22:06 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:22:06 user nova-compute[71500]:     <system>
Apr 14 16:22:06 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:22:06 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:22:06 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:22:06 user nova-compute[71500]:       <entry name="serial">20a0fd5f-afbb-42ca-be41-0d18535241b3</entry>
Apr 14 16:22:06 user nova-compute[71500]:       <entry name="uuid">20a0fd5f-afbb-42ca-be41-0d18535241b3</entry>
Apr 14 16:22:06 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:22:06 user nova-compute[71500]:     </system>
Apr 14 16:22:06 user nova-compute[71500]:   </sysinfo>
Apr 14 16:22:06 user nova-compute[71500]:   <os>
Apr 14 16:22:06 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:22:06 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:22:06 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:22:06 user nova-compute[71500]:   </os>
Apr 14 16:22:06 user nova-compute[71500]:   <features>
Apr 14 16:22:06 user nova-compute[71500]:     <acpi/>
Apr 14 16:22:06 user nova-compute[71500]:     <apic/>
Apr 14 16:22:06 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:22:06 user nova-compute[71500]:   </features>
Apr 14 16:22:06 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:22:06 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:22:06 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:22:06 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:22:06 user nova-compute[71500]:   </clock>
Apr 14 16:22:06 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:22:06 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:22:06 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:22:06 user nova-compute[71500]:   </cpu>
Apr 14 16:22:06 user nova-compute[71500]:   <devices>
Apr 14 16:22:06 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:22:06 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:22:06 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 16:22:06 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:22:06 user nova-compute[71500]:       <serial>14e6cb90-ca04-4130-8635-ab2c3243bd5e</serial>
Apr 14 16:22:06 user nova-compute[71500]:     </disk>
Apr 14 16:22:06 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:22:06 user nova-compute[71500]:       <mac address="fa:16:3e:a8:94:67"/>
Apr 14 16:22:06 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:22:06 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:22:06 user nova-compute[71500]:       <target dev="tap2bb3ffe9-ef"/>
Apr 14 16:22:06 user nova-compute[71500]:     </interface>
Apr 14 16:22:06 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:22:06 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/20a0fd5f-afbb-42ca-be41-0d18535241b3/console.log" append="off"/>
Apr 14 16:22:06 user nova-compute[71500]:     </serial>
Apr 14 16:22:06 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:22:06 user nova-compute[71500]:     <video>
Apr 14 16:22:06 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:22:06 user nova-compute[71500]:     </video>
Apr 14 16:22:06 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:22:06 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:22:06 user nova-compute[71500]:     </rng>
Apr 14 16:22:06 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:22:06 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:22:06 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:22:06 user nova-compute[71500]:     </memballoon>
Apr 14 16:22:06 user nova-compute[71500]:   </devices>
Apr 14 16:22:06 user nova-compute[71500]: </domain>
Apr 14 16:22:06 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-539389530',display_name='tempest-TestVolumeBootPattern-server-539389530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-539389530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-u12fpd4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:22:00Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=20a0fd5f-afbb-42ca-be41-0d18535241b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG os_vif [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bb3ffe9-ef, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bb3ffe9-ef, col_values=(('external_ids', {'iface-id': '2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:94:67', 'vm-uuid': '20a0fd5f-afbb-42ca-be41-0d18535241b3'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:06 user nova-compute[71500]: INFO os_vif [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef')
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:22:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No VIF found with MAC fa:16:3e:a8:94:67, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:22:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:22:07 user nova-compute[71500]: WARNING nova.compute.manager [req-45afd7dc-21be-40e2-9666-b22ee7000061 req-5855d720-5d69-4ccf-962c-e6fb99723ae9 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received unexpected event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with vm_state building and task_state spawning.
Apr 14 16:22:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489329.7784643, 20a0fd5f-afbb-42ca-be41-0d18535241b3 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:22:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] VM Resumed (Lifecycle Event)
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:22:09 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:22:09 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=26.06261444091797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:22:09 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Instance spawned successfully.
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:22:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489329.779849, 20a0fd5f-afbb-42ca-be41-0d18535241b3 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:22:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] VM Started (Lifecycle Event)
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:22:09 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0643d79c-19ea-44b2-888b-537717701f72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:22:09 user nova-compute[71500]: INFO nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:09 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:22:10 user nova-compute[71500]: INFO nova.compute.manager [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Took 10.51 seconds to build instance.
Apr 14 16:22:10 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-d82622b8-c314-417d-9f33-47fb4812157a tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.602s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:22:10 user nova-compute[71500]: DEBUG nova.compute.manager [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:22:10 user nova-compute[71500]: WARNING nova.compute.manager [req-92b0d567-439a-4f17-9747-7e45addfe4f7 req-a7ea6ef8-77f6-4f7b-bccf-9ca6e09924ce service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received unexpected event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with vm_state active and task_state None.
Apr 14 16:22:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updating instance_info_cache with network_info: [{"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-0643d79c-19ea-44b2-888b-537717701f72" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:11 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:22:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:22:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:22:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:22:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:22:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:22:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:22:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:22:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:22:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:23:11 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:23:11 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:23:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=26.061573028564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 0643d79c-19ea-44b2-888b-537717701f72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 20a0fd5f-afbb-42ca-be41-0d18535241b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:23:12 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updating instance_info_cache with network_info: [{"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:23:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:21 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 16:23:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 16:23:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 16:23:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:23:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:23:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:23:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG nova.objects.instance [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'flavor' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:23:40 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Ignoring supplied device name: /dev/vdb
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:40 user nova-compute[71500]: INFO nova.compute.manager [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Attaching volume 1e871d92-48ee-4567-9550-68341cafac5e to /dev/vdb
Apr 14 16:23:40 user nova-compute[71500]: DEBUG os_brick.utils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4865cb-a501-4bcc-ac97-df3c4547217c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797795b-bd79-4cee-8428-360f1e8cd8c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[48842c83-8e36-4301-8da8-bad55a77c179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07080b6-aee7-45e6-a49c-ff3f37ab86b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:23:40 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:23:40 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[42af349d-af3d-4c29-b2ff-4f569a9668b5]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG os_brick.utils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:23:40 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updating existing volume attachment record: 4f46635e-85b1-4d30-b3b6-2905f600aba2 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:23:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Triggering sync for uuid 20a0fd5f-afbb-42ca-be41-0d18535241b3 {{(pid=71500) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWpnUQCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:23:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:23:45 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:23:45 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b8434d-6f2e-4b5c-8580-693fe8ed1748]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:23:45 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b5eaed-dd8a-417c-8e57-aba807f2dff7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e] added
Apr 14 16:23:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc076d-08b1-498a-ad31-bca3df33e6fa]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2aea4b-b175-4f4d-9adf-b4e296bf1b3c]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWpnUQCd {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tWpnUQCd" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad9d089-188a-48a5-a0c6-490e19b70cd4]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tWpnUQCd'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89469b3-f8bb-49c6-b896-646fa9b63df2]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4910bb0-1619-4ba6-a6d6-d520ebe3ac4b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:23:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:23:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae466fb-af8e-4dac-834e-7b846a6cb220]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260]
Apr 14 16:23:45 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260] successful.
Apr 14 16:23:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91babdc7-b6ce-4a3f-a3ec-bf5506580358]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[525152a5-14c7-4b34-ba83-f31143fb6ab4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:23:45 user nova-compute[71500]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)
Apr 14 16:23:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:23:45 user nova-compute[71500]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)
Apr 14 16:23:45 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0daf1b-9365-4b56-a27e-c75c39bca493]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:23:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWpnUQCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:23:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:23:46 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23435643335623236', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:23:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435643335623236', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:23:46 user nova-compute[71500]: DEBUG nova.objects.instance [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'flavor' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:23:46 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 16:23:46 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:23:46 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:23:46 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:23:46 user nova-compute[71500]:   <serial>1e871d92-48ee-4567-9550-68341cafac5e</serial>
Apr 14 16:23:46 user nova-compute[71500]: </disk>
Apr 14 16:23:46 user nova-compute[71500]:  {{(pid=71500) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 16:23:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:23:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:23:47 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] No VIF found with MAC fa:16:3e:3a:22:d3, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:23:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-cb513178-e398-4e39-a028-795633861291 tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.014s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0643d79c-19ea-44b2-888b-537717701f72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.339s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "0643d79c-19ea-44b2-888b-537717701f72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:50 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-changed-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:51 user nova-compute[71500]: DEBUG nova.compute.manager [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Refreshing instance network info cache due to event network-changed-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:23:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Acquiring lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:23:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Acquired lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:23:51 user nova-compute[71500]: DEBUG nova.network.neutron [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Refreshing network info cache for port 2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:52 user nova-compute[71500]: INFO nova.compute.manager [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Terminating instance
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updated VIF entry in instance network info cache for port 2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.network.neutron [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updating instance_info_cache with network_info: [{"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5a1b6b30-c4fe-4e70-94e4-5579b9e8f2b5 req-2e74894b-5ffe-488a-b194-bc41336f43c0 service nova] Releasing lock "refresh_cache-20a0fd5f-afbb-42ca-be41-0d18535241b3" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-unplugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-unplugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.compute.manager [req-2f24b7d0-40d4-461c-bb4c-35a5ab63363f req-2eb5ca37-f438-41c4-8956-9603c8ef2167 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-unplugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:52 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Instance destroyed successfully.
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.objects.instance [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'resources' on Instance uuid 20a0fd5f-afbb-42ca-be41-0d18535241b3 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-539389530',display_name='tempest-TestVolumeBootPattern-server-539389530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-539389530',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-u12fpd4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:22:10Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=20a0fd5f-afbb-42ca-be41-0d18535241b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "address": "fa:16:3e:a8:94:67", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bb3ffe9-ef", "ovs_interfaceid": "2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:23:52 user nova-compute[71500]: DEBUG os_vif [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bb3ffe9-ef, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:23:53 user nova-compute[71500]: INFO os_vif [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:94:67,bridge_name='br-int',has_traffic_filtering=True,id=2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bb3ffe9-ef')
Apr 14 16:23:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:23:53 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90fe3a4-2b49-40b6-80e1-75dbad7d5547]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:23:53 user nova-compute[71500]: No targets found.
Apr 14 16:23:53 user nova-compute[71500]: iSNS:
Apr 14 16:23:53 user nova-compute[71500]: No targets found.
Apr 14 16:23:53 user nova-compute[71500]: STATIC:
Apr 14 16:23:53 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e
Apr 14 16:23:53 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:23:53 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:23:53 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e
Apr 14 16:23:53 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:23:53 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:23:53 user nova-compute[71500]: FIRMWARE:
Apr 14 16:23:53 user nova-compute[71500]: No targets found.
Apr 14 16:23:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:23:53 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:23:53 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b258da-bc68-4929-a8a5-c9384802816c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370d758-3a3a-4e90-a024-2f679f066a9d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:23:53 user nova-compute[71500]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)
Apr 14 16:23:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:23:53 user nova-compute[71500]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)
Apr 14 16:23:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf42f4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[23879270-b3c0-4a8a-9005-d627c5e6f517]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f67f8-a965-41e2-a275-31008413586b]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc440016-f7fa-40f0-8a4b-f8ab60e298ed]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8f6769-593a-47c0-9071-7b302e781784]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[593342b5-81e1-4306-beb4-46db88f09460]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baaff2c-ac35-4b2e-8a15-ab9d2fa8d7c2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]
Apr 14 16:23:53 user nova-compute[71500]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.
Apr 14 16:23:53 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3fce1-ee00-4f7d-919d-72afaaef0f90]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== disconnect_volume: return (337ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:23:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Deleting instance files /opt/stack/data/nova/instances/20a0fd5f-afbb-42ca-be41-0d18535241b3_del
Apr 14 16:23:53 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Deletion of /opt/stack/data/nova/instances/20a0fd5f-afbb-42ca-be41-0d18535241b3_del complete
Apr 14 16:23:53 user nova-compute[71500]: INFO nova.compute.manager [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 16:23:53 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:23:54 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Took 0.82 seconds to deallocate network for instance.
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-bab070f1-8ba7-4168-95b0-f555cba466bb req-e1438da4-b24d-41fd-a508-592594c6cc03 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-deleted-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:23:54 user nova-compute[71500]: WARNING nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received unexpected event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with vm_state active and task_state deleting.
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:23:54 user nova-compute[71500]: WARNING nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received unexpected event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with vm_state active and task_state deleting.
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:23:54 user nova-compute[71500]: WARNING nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received unexpected event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with vm_state active and task_state deleting.
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-unplugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-unplugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-unplugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Acquiring lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] No waiting events found dispatching network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:23:54 user nova-compute[71500]: WARNING nova.compute.manager [req-d4acbb4c-e150-4567-9ac1-1ed34846d6d6 req-b53a01b5-01fa-4dea-978f-be21336a9670 service nova] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Received unexpected event network-vif-plugged-2bb3ffe9-efdc-4fcc-ac37-2eaab30dee24 for instance with vm_state active and task_state deleting.
Apr 14 16:23:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:23:55 user nova-compute[71500]: INFO nova.compute.manager [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Took 0.81 seconds to detach 1 volumes for instance.
Apr 14 16:23:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:23:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:23:55 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:23:55 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:23:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:55 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Deleted allocations for instance 20a0fd5f-afbb-42ca-be41-0d18535241b3
Apr 14 16:23:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-2ae49e7b-3b0b-4b32-b5ef-e89dd29decaa tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "20a0fd5f-afbb-42ca-be41-0d18535241b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.216s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:23:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:24:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:04 user nova-compute[71500]: INFO nova.compute.manager [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Detaching volume 1e871d92-48ee-4567-9550-68341cafac5e
Apr 14 16:24:04 user nova-compute[71500]: INFO nova.virt.block_device [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Attempting to driver detach volume 1e871d92-48ee-4567-9550-68341cafac5e from mountpoint /dev/vdb
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Attempting to detach device vdb from instance 0643d79c-19ea-44b2-888b-537717701f72 from the persistent domain config. {{(pid=71500) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:24:04 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:24:04 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:24:04 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:24:04 user nova-compute[71500]:   <serial>1e871d92-48ee-4567-9550-68341cafac5e</serial>
Apr 14 16:24:04 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:24:04 user nova-compute[71500]: </disk>
Apr 14 16:24:04 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:24:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully detached device vdb from instance 0643d79c-19ea-44b2-888b-537717701f72 from the persistent domain config.
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0643d79c-19ea-44b2-888b-537717701f72 from the live domain config. {{(pid=71500) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.guest [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 16:24:04 user nova-compute[71500]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:24:04 user nova-compute[71500]:   <source dev="/dev/sdc"/>
Apr 14 16:24:04 user nova-compute[71500]:   <target dev="vdb" bus="virtio"/>
Apr 14 16:24:04 user nova-compute[71500]:   <serial>1e871d92-48ee-4567-9550-68341cafac5e</serial>
Apr 14 16:24:04 user nova-compute[71500]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 16:24:04 user nova-compute[71500]: </disk>
Apr 14 16:24:04 user nova-compute[71500]:  {{(pid=71500) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Received event <DeviceRemovedEvent: 1681489444.9682589, 0643d79c-19ea-44b2-888b-537717701f72 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71500) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 16:24:04 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully detached device vdb from instance 0643d79c-19ea-44b2-888b-537717701f72 from the live domain config.
Apr 14 16:24:04 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWpnUQCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:24:04 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:24:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:24:04 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a97b03b-63fe-478b-b150-c2c43b95a5a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:24:05 user nova-compute[71500]: No targets found.
Apr 14 16:24:05 user nova-compute[71500]: iSNS:
Apr 14 16:24:05 user nova-compute[71500]: No targets found.
Apr 14 16:24:05 user nova-compute[71500]: STATIC:
Apr 14 16:24:05 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e
Apr 14 16:24:05 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:24:05 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:24:05 user nova-compute[71500]: FIRMWARE:
Apr 14 16:24:05 user nova-compute[71500]: No targets found.
Apr 14 16:24:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:24:05 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:24:05 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15274d4-dd65-42d5-b15f-3b8e787a1b29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff26d8e-df5f-4bdf-9ec5-34595596bb44]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)
Apr 14 16:24:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e (non-flash)
Apr 14 16:24:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadbc4d6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1963c798-9583-485a-bb78-2ac71731ac83]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c49fb-b050-4fe1-98fb-5354500f1353]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf43423-2b1c-4abf-9278-7c49f4c8dcab]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f584cf89-2702-4bca-80f7-ae7189bd71ac]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d282b0-e6b6-4285-a85e-40a4753a46d8]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56e23d8-2666-4a5f-bb5f-7366f8bf19ef]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260]
Apr 14 16:24:05 user nova-compute[71500]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e, portal: 172.16.0.220,3260] successful.
Apr 14 16:24:05 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19baaf-ba10-4359-8095-ca13ebef3092]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== disconnect_volume: return (284ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:24:05 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'flavor' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-6668e1e8-6289-4001-a5e2-6f30b6c339af tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.632s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:06 user nova-compute[71500]: INFO nova.compute.manager [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Terminating instance
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.compute.manager [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-vif-unplugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] No waiting events found dispatching network-vif-unplugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.compute.manager [req-7b0dd0bf-efcd-4983-b3d5-114aaa9015c3 req-f374ff07-a494-4831-affc-c4feeefdb9fe service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-vif-unplugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:24:06 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Instance destroyed successfully.
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.objects.instance [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lazy-loading 'resources' on Instance uuid 0643d79c-19ea-44b2-888b-537717701f72 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:21:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-917436846',display_name='tempest-VolumesSnapshotTestJSON-instance-917436846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-917436846',id=44,image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e78327b280e74412bd43a54a522c20d0',ramdisk_id='',reservation_id='r-xwydzqpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e3a0daa8-78ae-44af-8756-1fad21c352f3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1091655053',owner_user_name='tempest-VolumesSnapshotTestJSON-1091655053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:21:56Z,user_data=None,user_id='ffdaf3dc40b0445ea03d2f69abd46924',uuid=0643d79c-19ea-44b2-888b-537717701f72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converting VIF {"id": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "address": "fa:16:3e:3a:22:d3", "network": {"id": "2873e414-99d7-4231-8560-2b553fe24429", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-563521521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "e78327b280e74412bd43a54a522c20d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56f6dba-69", "ovs_interfaceid": "a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG os_vif [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa56f6dba-69, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:06 user nova-compute[71500]: INFO os_vif [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:22:d3,bridge_name='br-int',has_traffic_filtering=True,id=a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27,network=Network(2873e414-99d7-4231-8560-2b553fe24429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56f6dba-69')
Apr 14 16:24:06 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:1e871d92-48ee-4567-9550-68341cafac5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tWpnUQCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:24:06 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:24:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:24:06 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[5a2f4268-dc5b-4077-afcd-8d65cb9802e5]: Unexpected error while running command.
Apr 14 16:24:06 user nova-compute[71500]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 16:24:06 user nova-compute[71500]: Exit code: 21
Apr 14 16:24:06 user nova-compute[71500]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 16:24:06 user nova-compute[71500]: Stderr: '' {{(pid=82501) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 16:24:06 user nova-compute[71500]: Traceback (most recent call last):
Apr 14 16:24:06 user nova-compute[71500]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 16:24:06 user nova-compute[71500]:     ret = func(*f_args, **f_kwargs)
Apr 14 16:24:06 user nova-compute[71500]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 16:24:06 user nova-compute[71500]:     return func(*args, **kwargs)
Apr 14 16:24:06 user nova-compute[71500]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 16:24:06 user nova-compute[71500]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 16:24:06 user nova-compute[71500]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 16:24:06 user nova-compute[71500]:     return putils.execute(on_execute=on_execute,
Apr 14 16:24:06 user nova-compute[71500]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 16:24:06 user nova-compute[71500]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 16:24:06 user nova-compute[71500]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 16:24:06 user nova-compute[71500]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 16:24:06 user nova-compute[71500]: Exit code: 21
Apr 14 16:24:06 user nova-compute[71500]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 16:24:06 user nova-compute[71500]: Stderr: ''
Apr 14 16:24:07 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2f4268-dc5b-4077-afcd-8d65cb9802e5]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 16:24:07 user nova-compute[71500]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 16:24:07 user nova-compute[71500]: Exit code: 21
Apr 14 16:24:07 user nova-compute[71500]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 16:24:07 user nova-compute[71500]: Stderr: ''
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 16:24:07 user nova-compute[71500]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 16:24:07 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71500) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.041s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] <== disconnect_volume: return (41ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:24:07 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Deleting instance files /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72_del
Apr 14 16:24:07 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Deletion of /opt/stack/data/nova/instances/0643d79c-19ea-44b2-888b-537717701f72_del complete
Apr 14 16:24:07 user nova-compute[71500]: INFO nova.compute.manager [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 16:24:07 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:24:07 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Took 0.63 seconds to deallocate network for instance.
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.compute.manager [req-f7c1ff3b-40a0-4a23-bbec-72e68bc3b616 req-fa619ba6-3a40-436a-909a-ac6052262a59 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-vif-deleted-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:24:07 user nova-compute[71500]: WARNING nova.volume.cinder [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Attachment 4f46635e-85b1-4d30-b3b6-2905f600aba2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4f46635e-85b1-4d30-b3b6-2905f600aba2. (HTTP 404) (Request-ID: req-295889b7-6c95-4e17-8620-a30645777a24)
Apr 14 16:24:07 user nova-compute[71500]: INFO nova.compute.manager [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Took 0.05 seconds to detach 1 volumes for instance.
Apr 14 16:24:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489432.9632146, 20a0fd5f-afbb-42ca-be41-0d18535241b3 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:24:07 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] VM Stopped (Lifecycle Event)
Apr 14 16:24:07 user nova-compute[71500]: DEBUG nova.compute.manager [None req-8b171940-b2cf-4f72-989c-44d3a77448d5 None None] [instance: 20a0fd5f-afbb-42ca-be41-0d18535241b3] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:24:07 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:08 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Deleted allocations for instance 0643d79c-19ea-44b2-888b-537717701f72
Apr 14 16:24:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-bb6c5937-5cc5-4a37-887e-62d88fa3afda tempest-VolumesSnapshotTestJSON-1091655053 tempest-VolumesSnapshotTestJSON-1091655053-project-member] Lock "0643d79c-19ea-44b2-888b-537717701f72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received event network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:24:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Acquiring lock "0643d79c-19ea-44b2-888b-537717701f72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:08 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] Lock "0643d79c-19ea-44b2-888b-537717701f72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:08 user nova-compute[71500]: DEBUG nova.compute.manager [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] No waiting events found dispatching network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:24:08 user nova-compute[71500]: WARNING nova.compute.manager [req-efe36005-fd3c-488a-8cc4-a331f3d6a832 req-399422de-e5cd-4e35-81f6-505cb4947532 service nova] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Received unexpected event network-vif-plugged-a56f6dba-699a-4d22-8fcd-c1e1b9ef8f27 for instance with vm_state deleted and task_state None.
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:24:11 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:24:11 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=26.070560455322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:24:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:24:12 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 16:24:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:13 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:24:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489446.9274478, 0643d79c-19ea-44b2-888b-537717701f72 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:24:21 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 0643d79c-19ea-44b2-888b-537717701f72] VM Stopped (Lifecycle Event)
Apr 14 16:24:21 user nova-compute[71500]: DEBUG nova.compute.manager [None req-1e64a46b-de44-4312-af06-66fc4491dc68 None None] [instance: 0643d79c-19ea-44b2-888b-537717701f72] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:24:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:24:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:43 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:24:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:43 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:24:44 user nova-compute[71500]: INFO nova.compute.claims [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Claim successful on node user
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:24:44 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:24:44 user nova-compute[71500]: INFO nova.virt.block_device [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Booting with volume 14e6cb90-ca04-4130-8635-ab2c3243bd5e at /dev/vda
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.policy [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG os_brick.utils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2987379-d1cb-43ea-830c-c5a06aa61baa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c77095-edf3-4fea-83a5-4218ed62f1e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba8e62e-568c-4624-bbb4-733aff140b89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc53a523-7659-4b26-abad-fc58246c8f41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:24:44 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:24:44 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3793598-242a-4b23-9f10-1084eefe1e69]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG os_brick.utils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:24:44 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating existing volume attachment record: 3ff2034c-7e77-4e3b-9bd8-64ed76833c6a {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Successfully created port: 20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Successfully updated port: 20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-changed-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG nova.compute.manager [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Refreshing instance network info cache due to event network-changed-20d85c39-102c-4f08-9b83-e1750d492acb. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:24:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Instance network_info: |[{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Refreshing network info cache for port 20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated VIF entry in instance network info cache for port 20d85c39-102c-4f08-9b83-e1750d492acb. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG nova.network.neutron [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-54a39cb1-acb1-45d0-b1bf-061503eab5ea req-0855a47c-20de-489e-9446-3856d673e413 service nova] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:24:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:24:51 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Creating image(s)
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Ensure instance console log exists: /opt/stack/data/nova/instances/ac2b0997-a081-43e2-874f-6ae3da3ddd58/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Start _get_guest_xml network_info=[{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '3ff2034c-7e77-4e3b-9bd8-64ed76833c6a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac2b0997-a081-43e2-874f-6ae3da3ddd58', 'attached_at': '', 'detached_at': '', 'volume_id': '14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'serial': '14e6cb90-ca04-4130-8635-ab2c3243bd5e'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:24:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:24:51 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:24:51 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:24:51 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:24:51 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd680da-3d9a-4bcd-a45f-8e25e6c63a8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:24:51 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e62986-e2ba-4da6-8e96-039b1cf84f12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e] added
Apr 14 16:24:51 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3383a0b1-b69c-41d2-803b-1e668b0a559d]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:51 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd62f96-8ecd-484a-8894-571ee5f00d27]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqZCnTr {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqZCnTr" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ed070d-9a77-49c9-bb20-7b1a1ab1238a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtqZCnTr'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4ec1a6-8e0c-473b-8bc0-d17d21100ac3]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d1719-3350-42e8-b55e-251da9d93732]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:24:52 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 16:24:52 user nova-compute[71500]:  {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:24:52 user nova-compute[71500]: WARNING os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 16:24:52 user nova-compute[71500]: 
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[48713d05-1e09-41a8-aa83-82fdbf3c2b60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]
Apr 14 16:24:52 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.
Apr 14 16:24:52 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cd848d-2058-4567-a885-915606bb5826]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0527589-6cfd-4a78-8e26-ebcc9cc2e1d5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:24:52 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:24:52 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34facef-b1de-40c5-9e49-f54a497793d4]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:24:52 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23537653562356435', 'path': '/dev/sdb'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537653562356435', 'path': '/dev/sdb'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-296106475',display_name='tempest-TestVolumeBootPattern-server-296106475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-296106475',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-78t8p004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:24:44Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=ac2b0997-a081-43e2-874f-6ae3da3ddd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.objects.instance [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'pci_devices' on Instance uuid ac2b0997-a081-43e2-874f-6ae3da3ddd58 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:24:53 user nova-compute[71500]:   <uuid>ac2b0997-a081-43e2-874f-6ae3da3ddd58</uuid>
Apr 14 16:24:53 user nova-compute[71500]:   <name>instance-0000002e</name>
Apr 14 16:24:53 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:24:53 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:24:53 user nova-compute[71500]:   <metadata>
Apr 14 16:24:53 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:24:53 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:24:53 user nova-compute[71500]:       <nova:name>tempest-TestVolumeBootPattern-server-296106475</nova:name>
Apr 14 16:24:53 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:24:51</nova:creationTime>
Apr 14 16:24:53 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:24:53 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:24:53 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:24:53 user nova-compute[71500]:       <nova:owner>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:user uuid="bb3b7ae19e044c3e90292751dd633279">tempest-TestVolumeBootPattern-1344751469-project-member</nova:user>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:project uuid="2ffc20a7a2f44e5cafb12334ea4230eb">tempest-TestVolumeBootPattern-1344751469</nova:project>
Apr 14 16:24:53 user nova-compute[71500]:       </nova:owner>
Apr 14 16:24:53 user nova-compute[71500]:       <nova:ports>
Apr 14 16:24:53 user nova-compute[71500]:         <nova:port uuid="20d85c39-102c-4f08-9b83-e1750d492acb">
Apr 14 16:24:53 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 16:24:53 user nova-compute[71500]:         </nova:port>
Apr 14 16:24:53 user nova-compute[71500]:       </nova:ports>
Apr 14 16:24:53 user nova-compute[71500]:     </nova:instance>
Apr 14 16:24:53 user nova-compute[71500]:   </metadata>
Apr 14 16:24:53 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:24:53 user nova-compute[71500]:     <system>
Apr 14 16:24:53 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:24:53 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:24:53 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:24:53 user nova-compute[71500]:       <entry name="serial">ac2b0997-a081-43e2-874f-6ae3da3ddd58</entry>
Apr 14 16:24:53 user nova-compute[71500]:       <entry name="uuid">ac2b0997-a081-43e2-874f-6ae3da3ddd58</entry>
Apr 14 16:24:53 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:24:53 user nova-compute[71500]:     </system>
Apr 14 16:24:53 user nova-compute[71500]:   </sysinfo>
Apr 14 16:24:53 user nova-compute[71500]:   <os>
Apr 14 16:24:53 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:24:53 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:24:53 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:24:53 user nova-compute[71500]:   </os>
Apr 14 16:24:53 user nova-compute[71500]:   <features>
Apr 14 16:24:53 user nova-compute[71500]:     <acpi/>
Apr 14 16:24:53 user nova-compute[71500]:     <apic/>
Apr 14 16:24:53 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:24:53 user nova-compute[71500]:   </features>
Apr 14 16:24:53 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:24:53 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:24:53 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:24:53 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:24:53 user nova-compute[71500]:   </clock>
Apr 14 16:24:53 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:24:53 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:24:53 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:24:53 user nova-compute[71500]:   </cpu>
Apr 14 16:24:53 user nova-compute[71500]:   <devices>
Apr 14 16:24:53 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:24:53 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:24:53 user nova-compute[71500]:       <source dev="/dev/sdb"/>
Apr 14 16:24:53 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:24:53 user nova-compute[71500]:       <serial>14e6cb90-ca04-4130-8635-ab2c3243bd5e</serial>
Apr 14 16:24:53 user nova-compute[71500]:     </disk>
Apr 14 16:24:53 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:24:53 user nova-compute[71500]:       <mac address="fa:16:3e:2b:26:3e"/>
Apr 14 16:24:53 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:24:53 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:24:53 user nova-compute[71500]:       <target dev="tap20d85c39-10"/>
Apr 14 16:24:53 user nova-compute[71500]:     </interface>
Apr 14 16:24:53 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:24:53 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/ac2b0997-a081-43e2-874f-6ae3da3ddd58/console.log" append="off"/>
Apr 14 16:24:53 user nova-compute[71500]:     </serial>
Apr 14 16:24:53 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:24:53 user nova-compute[71500]:     <video>
Apr 14 16:24:53 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:24:53 user nova-compute[71500]:     </video>
Apr 14 16:24:53 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:24:53 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:24:53 user nova-compute[71500]:     </rng>
Apr 14 16:24:53 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:24:53 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:24:53 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:24:53 user nova-compute[71500]:     </memballoon>
Apr 14 16:24:53 user nova-compute[71500]:   </devices>
Apr 14 16:24:53 user nova-compute[71500]: </domain>
Apr 14 16:24:53 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-296106475',display_name='tempest-TestVolumeBootPattern-server-296106475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-296106475',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-78t8p004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:24:44Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=ac2b0997-a081-43e2-874f-6ae3da3ddd58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG os_vif [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20d85c39-10, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20d85c39-10, col_values=(('external_ids', {'iface-id': '20d85c39-102c-4f08-9b83-e1750d492acb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:26:3e', 'vm-uuid': 'ac2b0997-a081-43e2-874f-6ae3da3ddd58'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:53 user nova-compute[71500]: INFO os_vif [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10')
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:24:53 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No VIF found with MAC fa:16:3e:2b:26:3e, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:54 user nova-compute[71500]: DEBUG nova.compute.manager [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] No waiting events found dispatching network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:24:54 user nova-compute[71500]: WARNING nova.compute.manager [req-a5f910c8-b6be-4d71-b937-470197180780 req-d77bf214-2643-4f56-8783-75073e79f9dd service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received unexpected event network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb for instance with vm_state building and task_state spawning.
Apr 14 16:24:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489496.7893658, ac2b0997-a081-43e2-874f-6ae3da3ddd58 => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] VM Resumed (Lifecycle Event)
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Instance spawned successfully.
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489496.7905836, ac2b0997-a081-43e2-874f-6ae3da3ddd58 => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] VM Started (Lifecycle Event)
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] No waiting events found dispatching network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:24:56 user nova-compute[71500]: WARNING nova.compute.manager [req-d4a2ac1b-62c0-409d-9a56-cd76110b9ee8 req-f3336c83-b7d7-4f80-a752-3fb51a83b191 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received unexpected event network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb for instance with vm_state building and task_state spawning.
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Took 5.06 seconds to spawn the instance on the hypervisor.
Apr 14 16:24:56 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:24:56 user nova-compute[71500]: INFO nova.compute.manager [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Took 13.02 seconds to build instance.
Apr 14 16:24:57 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-7eccf2b4-2f54-4bd6-ba9a-f5acde48a901 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.114s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:24:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:00 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:25:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:25:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:25:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:25:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:11 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:13 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:25:13 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8640MB free_disk=26.06839370727539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:25:13 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:25:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid ac2b0997-a081-43e2-874f-6ae3da3ddd58 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:25:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:25 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:25:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:25:58 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:03 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:26:08 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:26:12 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:13 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid ac2b0997-a081-43e2-874f-6ae3da3ddd58 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:26:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:26:15 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:26:15 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=26.067123413085938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:26:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:26:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:18 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:26:20 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:26:23 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:26:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:26:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:26:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:26:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:33 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-changed-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Refreshing instance network info cache due to event network-changed-20d85c39-102c-4f08-9b83-e1750d492acb. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Refreshing network info cache for port 20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated VIF entry in instance network info cache for port 20d85c39-102c-4f08-9b83-e1750d492acb. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:26:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-5625f8a9-c7ff-4bab-be8e-2717857b69ca req-2f55a2b1-f6c4-441f-824d-9d81f99f7f0d service nova] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:26:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:43 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:44 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Starting instance... {{(pid=71500) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 16:26:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:44 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:44 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71500) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 16:26:44 user nova-compute[71500]: INFO nova.compute.claims [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Claim successful on node user
Apr 14 16:26:45 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Start building networks asynchronously for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Allocating IP information in the background. {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] allocate_for_instance() {{(pid=71500) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 16:26:45 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Start building block device mappings for instance. {{(pid=71500) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 16:26:45 user nova-compute[71500]: INFO nova.virt.block_device [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Booting with volume 6dbbdd8f-8039-4897-9a0c-d7e601864dfe at /dev/vda
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.policy [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb3b7ae19e044c3e90292751dd633279', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffc20a7a2f44e5cafb12334ea4230eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71500) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG os_brick.utils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf90d92-70b5-404e-a1d7-dc68ffdb54d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bafe78cc3fb\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d559f-5f5e-400c-aa7d-0618f1264607]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30425ad-0830-4fab-af4b-516d1a6d67bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9caec2-229f-4e03-aa54-74a91833f3e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Running cmd (subprocess): nvme version {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] 'nvme version' failed. Not Retrying. {{(pid=71500) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] nvme not present on system {{(pid=71500) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 16:26:45 user nova-compute[71500]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 16:26:45 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[033cfa9f-83ec-4142-a55d-8907f6480ced]: (4, '') {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71500) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.lightos [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] LIGHTOS: no hostnqn found. {{(pid=71500) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG os_brick.utils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bafe78cc3fb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:26:45 user nova-compute[71500]: DEBUG nova.virt.block_device [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating existing volume attachment record: 8b32a036-48b3-489e-a7b8-ce95c7706530 {{(pid=71500) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Successfully created port: 83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Successfully updated port: 83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquired lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Building network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-changed-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG nova.compute.manager [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Refreshing instance network info cache due to event network-changed-83b3270a-0b9d-48d8-89a4-60b99748fc88. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Acquiring lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:26:46 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Instance cache missing network info. {{(pid=71500) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG nova.network.neutron [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating instance_info_cache with network_info: [{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Releasing lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Instance network_info: |[{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71500) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Acquired lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Refreshing network info cache for port 83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updated VIF entry in instance network info cache for port 83b3270a-0b9d-48d8-89a4-60b99748fc88. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG nova.network.neutron [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating instance_info_cache with network_info: [{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:26:47 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-095111aa-4307-4824-b104-5ad4f909481b req-020ee11e-179d-4a54-b916-1fa1be35a1a6 service nova] Releasing lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:26:48 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Start spawning the instance on the hypervisor. {{(pid=71500) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Creating instance directory {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 16:26:50 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Creating image(s)
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Did not create local disks {{(pid=71500) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Ensure instance console log exists: /opt/stack/data/nova/instances/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef/console.log {{(pid=71500) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Start _get_guest_xml network_info=[{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '8b32a036-48b3-489e-a7b8-ce95c7706530', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtfqhIyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57bc1733-8a0c-49cc-85aa-e14b56cdc2ef', 'attached_at': '', 'detached_at': '', 'volume_id': '6dbbdd8f-8039-4897-9a0c-d7e601864dfe', 'serial': '6dbbdd8f-8039-4897-9a0c-d7e601864dfe'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 16:26:50 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:26:50 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71500) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T15:33:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image limits 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flavor pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Image pref 0:0:0 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71500) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Got 1 possible topologies {{(pid=71500) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.hardware [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71500) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Calling os-brick to attach iSCSI Volume {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtfqhIyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:26:50 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:26:50 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:26:50 user nova-compute[71500]: INFO os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c6bf86-edae-4a15-9bab-da79cee34dac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 16:26:50 user nova-compute[71500]:  {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --interface default --op new {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae58bc80-6e3e-4703-bc76-11047da416cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe] added\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe] added
Apr 14 16:26:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30a4173-54b9-4cd5-96d2-43ce8c48e537]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc21b3-9dd9-4119-b9d3-afd3f8164caa]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtfqhIyg {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtfqhIyg" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6bf57a-784c-4bc3-ad51-5f726274cd55]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KtfqhIyg'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6208d07-1085-4995-ae32-a2e97ad80e6b]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25c13db-bbc2-4507-b18c-fc57fb508fee]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:26:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:26:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --login {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dd5f07-f2fc-4103-b908-998cb5d7f3cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260]
Apr 14 16:26:50 user nova-compute[71500]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260] successful.
Apr 14 16:26:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4cc8f-84cc-4769-a8b1-32b79439cbdf]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd10cd1-597b-4f95-bcc3-dde47f0cbf7e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:26:50 user nova-compute[71500]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe (non-flash)
Apr 14 16:26:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:26:50 user nova-compute[71500]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe (non-flash)
Apr 14 16:26:50 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to 172.16.0.220:3260 {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71500) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71500) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[198720e5-10fe-4b4d-9ba9-abe2df7891e8]: (4, ('- - 0', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71500) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 16:26:50 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtfqhIyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71500) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26637323861346164', 'path': '/dev/sdc'} {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637323861346164', 'path': '/dev/sdc'} {{(pid=71500) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412536963',display_name='tempest-TestVolumeBootPattern-server-412536963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412536963',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-ynjjq7t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:26:45Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=57bc1733-8a0c-49cc-85aa-e14b56cdc2ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71500) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.objects.instance [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'pci_devices' on Instance uuid 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] End _get_guest_xml xml=<domain type="kvm">
Apr 14 16:26:51 user nova-compute[71500]:   <uuid>57bc1733-8a0c-49cc-85aa-e14b56cdc2ef</uuid>
Apr 14 16:26:51 user nova-compute[71500]:   <name>instance-0000002f</name>
Apr 14 16:26:51 user nova-compute[71500]:   <memory>131072</memory>
Apr 14 16:26:51 user nova-compute[71500]:   <vcpu>1</vcpu>
Apr 14 16:26:51 user nova-compute[71500]:   <metadata>
Apr 14 16:26:51 user nova-compute[71500]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 16:26:51 user nova-compute[71500]:       <nova:package version="0.0.0"/>
Apr 14 16:26:51 user nova-compute[71500]:       <nova:name>tempest-TestVolumeBootPattern-server-412536963</nova:name>
Apr 14 16:26:51 user nova-compute[71500]:       <nova:creationTime>2023-04-14 16:26:50</nova:creationTime>
Apr 14 16:26:51 user nova-compute[71500]:       <nova:flavor name="m1.nano">
Apr 14 16:26:51 user nova-compute[71500]:         <nova:memory>128</nova:memory>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:disk>1</nova:disk>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:swap>0</nova:swap>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:vcpus>1</nova:vcpus>
Apr 14 16:26:51 user nova-compute[71500]:       </nova:flavor>
Apr 14 16:26:51 user nova-compute[71500]:       <nova:owner>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:user uuid="bb3b7ae19e044c3e90292751dd633279">tempest-TestVolumeBootPattern-1344751469-project-member</nova:user>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:project uuid="2ffc20a7a2f44e5cafb12334ea4230eb">tempest-TestVolumeBootPattern-1344751469</nova:project>
Apr 14 16:26:51 user nova-compute[71500]:       </nova:owner>
Apr 14 16:26:51 user nova-compute[71500]:       <nova:ports>
Apr 14 16:26:51 user nova-compute[71500]:         <nova:port uuid="83b3270a-0b9d-48d8-89a4-60b99748fc88">
Apr 14 16:26:51 user nova-compute[71500]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 16:26:51 user nova-compute[71500]:         </nova:port>
Apr 14 16:26:51 user nova-compute[71500]:       </nova:ports>
Apr 14 16:26:51 user nova-compute[71500]:     </nova:instance>
Apr 14 16:26:51 user nova-compute[71500]:   </metadata>
Apr 14 16:26:51 user nova-compute[71500]:   <sysinfo type="smbios">
Apr 14 16:26:51 user nova-compute[71500]:     <system>
Apr 14 16:26:51 user nova-compute[71500]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 16:26:51 user nova-compute[71500]:       <entry name="product">OpenStack Nova</entry>
Apr 14 16:26:51 user nova-compute[71500]:       <entry name="version">0.0.0</entry>
Apr 14 16:26:51 user nova-compute[71500]:       <entry name="serial">57bc1733-8a0c-49cc-85aa-e14b56cdc2ef</entry>
Apr 14 16:26:51 user nova-compute[71500]:       <entry name="uuid">57bc1733-8a0c-49cc-85aa-e14b56cdc2ef</entry>
Apr 14 16:26:51 user nova-compute[71500]:       <entry name="family">Virtual Machine</entry>
Apr 14 16:26:51 user nova-compute[71500]:     </system>
Apr 14 16:26:51 user nova-compute[71500]:   </sysinfo>
Apr 14 16:26:51 user nova-compute[71500]:   <os>
Apr 14 16:26:51 user nova-compute[71500]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 16:26:51 user nova-compute[71500]:     <boot dev="hd"/>
Apr 14 16:26:51 user nova-compute[71500]:     <smbios mode="sysinfo"/>
Apr 14 16:26:51 user nova-compute[71500]:   </os>
Apr 14 16:26:51 user nova-compute[71500]:   <features>
Apr 14 16:26:51 user nova-compute[71500]:     <acpi/>
Apr 14 16:26:51 user nova-compute[71500]:     <apic/>
Apr 14 16:26:51 user nova-compute[71500]:     <vmcoreinfo/>
Apr 14 16:26:51 user nova-compute[71500]:   </features>
Apr 14 16:26:51 user nova-compute[71500]:   <clock offset="utc">
Apr 14 16:26:51 user nova-compute[71500]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 16:26:51 user nova-compute[71500]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 16:26:51 user nova-compute[71500]:     <timer name="hpet" present="no"/>
Apr 14 16:26:51 user nova-compute[71500]:   </clock>
Apr 14 16:26:51 user nova-compute[71500]:   <cpu mode="custom" match="exact">
Apr 14 16:26:51 user nova-compute[71500]:     <model>Nehalem</model>
Apr 14 16:26:51 user nova-compute[71500]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 16:26:51 user nova-compute[71500]:   </cpu>
Apr 14 16:26:51 user nova-compute[71500]:   <devices>
Apr 14 16:26:51 user nova-compute[71500]:     <disk type="block" device="disk">
Apr 14 16:26:51 user nova-compute[71500]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 16:26:51 user nova-compute[71500]:       <source dev="/dev/sdc"/>
Apr 14 16:26:51 user nova-compute[71500]:       <target dev="vda" bus="virtio"/>
Apr 14 16:26:51 user nova-compute[71500]:       <serial>6dbbdd8f-8039-4897-9a0c-d7e601864dfe</serial>
Apr 14 16:26:51 user nova-compute[71500]:     </disk>
Apr 14 16:26:51 user nova-compute[71500]:     <interface type="ethernet">
Apr 14 16:26:51 user nova-compute[71500]:       <mac address="fa:16:3e:7b:c7:81"/>
Apr 14 16:26:51 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:26:51 user nova-compute[71500]:       <mtu size="1442"/>
Apr 14 16:26:51 user nova-compute[71500]:       <target dev="tap83b3270a-0b"/>
Apr 14 16:26:51 user nova-compute[71500]:     </interface>
Apr 14 16:26:51 user nova-compute[71500]:     <serial type="pty">
Apr 14 16:26:51 user nova-compute[71500]:       <log file="/opt/stack/data/nova/instances/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef/console.log" append="off"/>
Apr 14 16:26:51 user nova-compute[71500]:     </serial>
Apr 14 16:26:51 user nova-compute[71500]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 16:26:51 user nova-compute[71500]:     <video>
Apr 14 16:26:51 user nova-compute[71500]:       <model type="virtio"/>
Apr 14 16:26:51 user nova-compute[71500]:     </video>
Apr 14 16:26:51 user nova-compute[71500]:     <rng model="virtio">
Apr 14 16:26:51 user nova-compute[71500]:       <backend model="random">/dev/urandom</backend>
Apr 14 16:26:51 user nova-compute[71500]:     </rng>
Apr 14 16:26:51 user nova-compute[71500]:     <controller type="usb" index="0" model="none"/>
Apr 14 16:26:51 user nova-compute[71500]:     <memballoon model="virtio">
Apr 14 16:26:51 user nova-compute[71500]:       <stats period="10"/>
Apr 14 16:26:51 user nova-compute[71500]:     </memballoon>
Apr 14 16:26:51 user nova-compute[71500]:   </devices>
Apr 14 16:26:51 user nova-compute[71500]: </domain>
Apr 14 16:26:51 user nova-compute[71500]:  {{(pid=71500) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412536963',display_name='tempest-TestVolumeBootPattern-server-412536963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412536963',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-ynjjq7t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T16:26:45Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=57bc1733-8a0c-49cc-85aa-e14b56cdc2ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG os_vif [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b') {{(pid=71500) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83b3270a-0b, may_exist=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83b3270a-0b, col_values=(('external_ids', {'iface-id': '83b3270a-0b9d-48d8-89a4-60b99748fc88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:c7:81', 'vm-uuid': '57bc1733-8a0c-49cc-85aa-e14b56cdc2ef'}),)) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:51 user nova-compute[71500]: INFO os_vif [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b')
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No BDM found with device name vda, not building metadata. {{(pid=71500) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 16:26:51 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] No VIF found with MAC fa:16:3e:7b:c7:81, not building metadata {{(pid=71500) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 16:26:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:26:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:53 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:53 user nova-compute[71500]: DEBUG nova.compute.manager [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] No waiting events found dispatching network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:26:53 user nova-compute[71500]: WARNING nova.compute.manager [req-3bdc2ddd-8f80-4bf7-b179-925c4e03d68d req-5c20834c-a5e8-4ac4-99d5-0249a83944e7 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received unexpected event network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance with vm_state building and task_state spawning.
Apr 14 16:26:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:53 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489615.0812514, 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => Resumed> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] VM Resumed (Lifecycle Event)
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Instance event wait completed in 0 seconds for  {{(pid=71500) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Guest created on hypervisor {{(pid=71500) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Instance spawned successfully.
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Found default for hw_cdrom_bus of ide {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Found default for hw_disk_bus of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Found default for hw_input_bus of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Found default for hw_pointer_model of None {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Found default for hw_video_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Found default for hw_vif_model of virtio {{(pid=71500) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.virt.driver [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] Emitting event <LifecycleEvent: 1681489615.0824225, 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => Started> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] VM Started (Lifecycle Event)
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71500) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.compute.manager [None req-7095fd6b-407e-4174-940d-ccb3fbfd4f9e None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Took 4.96 seconds to spawn the instance on the hypervisor.
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:55 user nova-compute[71500]: DEBUG nova.compute.manager [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] No waiting events found dispatching network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:26:55 user nova-compute[71500]: WARNING nova.compute.manager [req-c5ff134d-6a33-4e9e-9b87-b0ce91bd78a4 req-5791926d-ffec-46c7-a340-665b90dd89e8 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received unexpected event network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance with vm_state building and task_state spawning.
Apr 14 16:26:55 user nova-compute[71500]: INFO nova.compute.manager [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Took 10.33 seconds to build instance.
Apr 14 16:26:55 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-c7218e48-dc0a-488b-8e61-e73cda2190a1 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.420s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:26:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:13 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid ac2b0997-a081-43e2-874f-6ae3da3ddd58 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:27:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:15 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:16 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:27:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:27:17 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:27:17 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8612MB free_disk=26.06521987915039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:27:17 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:27:20 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:20 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:22 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:27:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:27:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:27:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:27:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:28 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:27:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:35 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:41 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:27:46 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:27:51 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:27:56 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:01 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:06 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:10 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:11 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:14 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:14 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:28:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:28:14 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:28:14 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:28:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating instance_info_cache with network_info: [{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:28:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:28:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:28:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:16 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:16 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:28:19 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:28:19 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8701MB free_disk=26.064620971679688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing inventories for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating ProviderTree inventory for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Updating inventory in ProviderTree for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing aggregate associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, aggregates: None {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Refreshing trait associations for resource provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ACCELERATORS {{(pid=71500) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:28:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:21 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:22 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:23 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71500) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 16:28:25 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:26 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Cleaning up deleted instances {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 16:28:27 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] There are 0 instances to clean {{(pid=71500) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 16:28:30 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:28:31 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:36 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-changed-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:28:37 user nova-compute[71500]: DEBUG nova.compute.manager [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Refreshing instance network info cache due to event network-changed-83b3270a-0b9d-48d8-89a4-60b99748fc88. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:28:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Acquiring lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:28:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Acquired lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:28:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Refreshing network info cache for port 83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updated VIF entry in instance network info cache for port 83b3270a-0b9d-48d8-89a4-60b99748fc88. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating instance_info_cache with network_info: [{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-b630cad4-a030-412c-b945-49586a71e49e req-b671bf6e-7ab7-40d9-a1d1-1dfacc236fb0 service nova] Releasing lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-changed-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG nova.compute.manager [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Refreshing instance network info cache due to event network-changed-83b3270a-0b9d-48d8-89a4-60b99748fc88. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Acquiring lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Acquired lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG nova.network.neutron [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Refreshing network info cache for port 83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:38 user nova-compute[71500]: INFO nova.compute.manager [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Terminating instance
Apr 14 16:28:38 user nova-compute[71500]: DEBUG nova.compute.manager [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updated VIF entry in instance network info cache for port 83b3270a-0b9d-48d8-89a4-60b99748fc88. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.network.neutron [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating instance_info_cache with network_info: [{"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-cf6fd75c-08ef-4d6f-99e9-ba78c3c14e3a req-1554f6b6-8cad-4ad2-87c4-4b8d8f1d818c service nova] Releasing lock "refresh_cache-57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:28:39 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Instance destroyed successfully.
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.objects.instance [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'resources' on Instance uuid 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412536963',display_name='tempest-TestVolumeBootPattern-server-412536963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412536963',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:26:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-ynjjq7t8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:26:55Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=57bc1733-8a0c-49cc-85aa-e14b56cdc2ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "address": "fa:16:3e:7b:c7:81", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83b3270a-0b", "ovs_interfaceid": "83b3270a-0b9d-48d8-89a4-60b99748fc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_vif [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83b3270a-0b, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:39 user nova-compute[71500]: INFO os_vif [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:81,bridge_name='br-int',has_traffic_filtering=True,id=83b3270a-0b9d-48d8-89a4-60b99748fc88,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83b3270a-0b')
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtfqhIyg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:28:39 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[6555c026-3a8c-417d-b3f6-9f100b66602e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:28:39 user nova-compute[71500]: No targets found.
Apr 14 16:28:39 user nova-compute[71500]: iSNS:
Apr 14 16:28:39 user nova-compute[71500]: No targets found.
Apr 14 16:28:39 user nova-compute[71500]: STATIC:
Apr 14 16:28:39 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe
Apr 14 16:28:39 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:28:39 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:28:39 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e
Apr 14 16:28:39 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:28:39 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:28:39 user nova-compute[71500]: FIRMWARE:
Apr 14 16:28:39 user nova-compute[71500]: No targets found.
Apr 14 16:28:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:28:39 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:28:39 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ef334-665b-498b-811d-d53f7959ad2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db3da9-7a2b-4d38-98a8-05c466f049b7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:28:39 user nova-compute[71500]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe (non-flash)
Apr 14 16:28:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:28:39 user nova-compute[71500]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe (non-flash)
Apr 14 16:28:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fadf4307910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe'): ({'sdc'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Removing single pathed devices sdc {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[218a075e-c071-4a36-9b83-765f40395f32]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b7927-7d20-48e4-a416-c0e5f5a754db]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flushing IO for device /dev/sdc {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dbd2d6-502f-4eec-b0a6-93019894b732]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-vif-unplugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] No waiting events found dispatching network-vif-unplugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-vif-unplugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Acquiring lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] No waiting events found dispatching network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:28:39 user nova-compute[71500]: WARNING nova.compute.manager [req-36f82073-9be0-43a1-b3ba-0fc4983bc755 req-06f3ebb0-77d4-4753-9824-904a07131270 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received unexpected event network-vif-plugged-83b3270a-0b9d-48d8-89a4-60b99748fc88 for instance with vm_state active and task_state deleting.
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b86fa50-94d8-4e74-9941-8d21701281d6]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] SCSI volumes sdc have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[683553c3-0732-430e-a099-a5e1885d1090]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e6421-3281-4ea6-b16a-26f8e676e150]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260]
Apr 14 16:28:39 user nova-compute[71500]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe, portal: 172.16.0.220,3260] successful.
Apr 14 16:28:39 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dbbdd8f-8039-4897-9a0c-d7e601864dfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bf0364-d407-4205-8355-bbe143faae1f]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== disconnect_volume: return (339ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:28:39 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Deleting instance files /opt/stack/data/nova/instances/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef_del
Apr 14 16:28:39 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Deletion of /opt/stack/data/nova/instances/57bc1733-8a0c-49cc-85aa-e14b56cdc2ef_del complete
Apr 14 16:28:39 user nova-compute[71500]: INFO nova.compute.manager [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 16:28:39 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:28:39 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:28:40 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:40 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:28:40 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Took 0.56 seconds to deallocate network for instance.
Apr 14 16:28:40 user nova-compute[71500]: DEBUG nova.compute.manager [req-ba174ddb-37b8-4b99-a438-ad159c152cd2 req-1da86925-1fde-49f4-a66e-0fa853a14ff7 service nova] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Received event network-vif-deleted-83b3270a-0b9d-48d8-89a4-60b99748fc88 {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:28:41 user nova-compute[71500]: INFO nova.compute.manager [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Took 0.90 seconds to detach 1 volumes for instance.
Apr 14 16:28:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:28:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:28:41 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:28:41 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:28:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:41 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Deleted allocations for instance 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef
Apr 14 16:28:41 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-67d9bd43-744a-4133-8acc-205fe11f2a98 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "57bc1733-8a0c-49cc-85aa-e14b56cdc2ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.012s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:28:44 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:49 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489719.5022738, 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:28:54 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] VM Stopped (Lifecycle Event)
Apr 14 16:28:54 user nova-compute[71500]: DEBUG nova.compute.manager [None req-3aefe343-d812-408b-87b1-2aaf85dc42e0 None None] [instance: 57bc1733-8a0c-49cc-85aa-e14b56cdc2ef] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:28:54 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:28:59 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:29:04 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:29:09 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:29:14 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Forcefully refreshing network info cache for instance {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG nova.objects.instance [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lazy-loading 'info_cache' on Instance uuid ac2b0997-a081-43e2-874f-6ae3da3ddd58 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG nova.network.neutron [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:29:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated the network info_cache for instance {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 16:29:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71500) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 16:29:19 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:29:19 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=26.055889129638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Instance ac2b0997-a081-43e2-874f-6ae3da3ddd58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71500) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:29:19 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:24 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:24 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:27 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:29 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:29:31 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:29:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-changed-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:29:36 user nova-compute[71500]: DEBUG nova.compute.manager [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Refreshing instance network info cache due to event network-changed-20d85c39-102c-4f08-9b83-e1750d492acb. {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 16:29:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Acquiring lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 16:29:36 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Acquired lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 16:29:36 user nova-compute[71500]: DEBUG nova.network.neutron [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Refreshing network info cache for port 20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:37 user nova-compute[71500]: INFO nova.compute.manager [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Terminating instance
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.compute.manager [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Start destroying the instance on the hypervisor. {{(pid=71500) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updated VIF entry in instance network info cache for port 20d85c39-102c-4f08-9b83-e1750d492acb. {{(pid=71500) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.network.neutron [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [{"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-a0a3c36d-dee1-4ce6-8faa-ec4bf75cfdaa req-8b61484c-450a-4c18-b66d-92543ddb91ac service nova] Releasing lock "refresh_cache-ac2b0997-a081-43e2-874f-6ae3da3ddd58" {{(pid=71500) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 16:29:37 user nova-compute[71500]: INFO nova.virt.libvirt.driver [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Instance destroyed successfully.
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.objects.instance [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lazy-loading 'resources' on Instance uuid ac2b0997-a081-43e2-874f-6ae3da3ddd58 {{(pid=71500) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.vif [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T16:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-296106475',display_name='tempest-TestVolumeBootPattern-server-296106475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-296106475',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPHd4sEqaSCGw6tAJCgB0daa6LORU2PmplYbEswYbOkD/hLJ+DdXkb5s9bzAlQ/Murb7CDKt1l6B0g+rfmWtaTX4oQZoaWyQ+hsivQlhsU9H+GSkrtj9TRMTDneLaaz4g==',key_name='tempest-TestVolumeBootPattern-1752336842',keypairs=<?>,launch_index=0,launched_at=2023-04-14T16:24:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ffc20a7a2f44e5cafb12334ea4230eb',ramdisk_id='',reservation_id='r-78t8p004',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1344751469',owner_user_name='tempest-TestVolumeBootPattern-1344751469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T16:24:57Z,user_data=None,user_id='bb3b7ae19e044c3e90292751dd633279',uuid=ac2b0997-a081-43e2-874f-6ae3da3ddd58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converting VIF {"id": "20d85c39-102c-4f08-9b83-e1750d492acb", "address": "fa:16:3e:2b:26:3e", "network": {"id": "43ce94ae-5ff4-4006-b800-67d1f29a9898", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1058576664-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ffc20a7a2f44e5cafb12334ea4230eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20d85c39-10", "ovs_interfaceid": "20d85c39-102c-4f08-9b83-e1750d492acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.network.os_vif_util [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10') {{(pid=71500) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_vif [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10') {{(pid=71500) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20d85c39-10, bridge=br-int, if_exists=True) {{(pid=71500) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:37 user nova-compute[71500]: INFO os_vif [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:26:3e,bridge_name='br-int',has_traffic_filtering=True,id=20d85c39-102c-4f08-9b83-e1750d492acb,network=Network(43ce94ae-5ff4-4006-b800-67d1f29a9898),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20d85c39-10')
Apr 14 16:29:37 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] calling os-brick to detach iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7faddc1a3640>, {'target_iqn': 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqZCnTr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 16:29:37 user nova-compute[71500]: WARNING os_brick.initiator.connectors.base [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de8d66-8011-4ef3-91e9-178aa4712090]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 16:29:37 user nova-compute[71500]: No targets found.
Apr 14 16:29:37 user nova-compute[71500]: iSNS:
Apr 14 16:29:37 user nova-compute[71500]: No targets found.
Apr 14 16:29:37 user nova-compute[71500]: STATIC:
Apr 14 16:29:37 user nova-compute[71500]: Target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e
Apr 14 16:29:37 user nova-compute[71500]:         Portal: 172.16.0.220:3260,-1
Apr 14 16:29:37 user nova-compute[71500]:                 Iface Name: default
Apr 14 16:29:37 user nova-compute[71500]: FIRMWARE:
Apr 14 16:29:37 user nova-compute[71500]: No targets found.
Apr 14 16:29:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 16:29:37 user nova-compute[71500]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 16:29:37 user nova-compute[71500]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71500) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e', 0)] {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fb4b2f-db5c-497d-bcea-d22c4495063e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a185361-c172-4a07-a25a-c29ac8d893a8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:29:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e (non-flash)
Apr 14 16:29:37 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fae0217fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e'): ({'sdb'}, set())}) {{(pid=71500) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Removing single pathed devices sdb {{(pid=71500) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 16:29:37 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe82c9-668b-475a-814b-829b846a8a88]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a60237-9e2e-411a-90f1-fb6bc667cf9b]: (4, ('ok\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Flushing IO for device /dev/sdb {{(pid=71500) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a70420-ab71-4584-8809-81a1230c3964]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71500) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bffe7a7-3dd7-4785-a2ba-6fdf484ac205]: (4, ('1', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.linuxscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] SCSI volumes sdb have been removed. {{(pid=71500) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23537653562356435', '/dev/disk/by-id/scsi-1SCST_BIOda2e424c-57e5b5d52d93ac6e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da2e424c') {{(pid=82501) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[2715649f-51d0-4b40-9ba8-7ee5be32b9f1]: (4, None) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e')] {{(pid=71500) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30dc8ca-95a6-4683-beec-3b8afb73b197]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --logout {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[434fdecd-3187-4a2e-b0dd-794f5bca9552]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260]
Apr 14 16:29:38 user nova-compute[71500]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e, portal: 172.16.0.220,3260] successful.
Apr 14 16:29:38 user nova-compute[71500]:  stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op delete {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14e6cb90-ca04-4130-8635-ab2c3243bd5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82501) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe9fb2f-b20e-405d-ad8a-bee5d6ba2f2a]: (4, ('', '')) {{(pid=82501) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71500) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.base [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG os_brick.initiator.connectors.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] <== disconnect_volume: return (362ms) None {{(pid=71500) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Disconnected iSCSI Volume {{(pid=71500) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 16:29:38 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Deleting instance files /opt/stack/data/nova/instances/ac2b0997-a081-43e2-874f-6ae3da3ddd58_del
Apr 14 16:29:38 user nova-compute[71500]: INFO nova.virt.libvirt.driver [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Deletion of /opt/stack/data/nova/instances/ac2b0997-a081-43e2-874f-6ae3da3ddd58_del complete
Apr 14 16:29:38 user nova-compute[71500]: INFO nova.compute.manager [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Took 1.26 seconds to destroy the instance on the hypervisor.
Apr 14 16:29:38 user nova-compute[71500]: DEBUG oslo.service.loopingcall [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71500) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG nova.compute.manager [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Deallocating network for instance {{(pid=71500) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 16:29:38 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] deallocate_for_instance() {{(pid=71500) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-vif-unplugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] No waiting events found dispatching network-vif-unplugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-vif-unplugged-20d85c39-102c-4f08-9b83-e1750d492acb for instance with task_state deleting. {{(pid=71500) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Acquiring lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG nova.compute.manager [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] No waiting events found dispatching network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 16:29:39 user nova-compute[71500]: WARNING nova.compute.manager [req-0a6f7105-cf35-4662-8739-3992dde33420 req-e90df931-9c4c-4e1b-baea-0201e6189e7b service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received unexpected event network-vif-plugged-20d85c39-102c-4f08-9b83-e1750d492acb for instance with vm_state active and task_state deleting.
Apr 14 16:29:39 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:39 user nova-compute[71500]: DEBUG nova.network.neutron [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Updating instance_info_cache with network_info: [] {{(pid=71500) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 16:29:39 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Took 0.96 seconds to deallocate network for instance.
Apr 14 16:29:40 user nova-compute[71500]: INFO nova.compute.manager [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 16:29:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:29:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:29:40 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:29:40 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:29:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:40 user nova-compute[71500]: INFO nova.scheduler.client.report [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Deleted allocations for instance ac2b0997-a081-43e2-874f-6ae3da3ddd58
Apr 14 16:29:40 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-16695b83-105e-499c-8908-a4cceca42e30 tempest-TestVolumeBootPattern-1344751469 tempest-TestVolumeBootPattern-1344751469-project-member] Lock "ac2b0997-a081-43e2-874f-6ae3da3ddd58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.301s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:29:41 user nova-compute[71500]: DEBUG nova.compute.manager [req-abfb97b5-3316-4481-a98b-bcb05613a41b req-107c8eb1-9764-466b-a392-3ce3aedafba3 service nova] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Received event network-vif-deleted-20d85c39-102c-4f08-9b83-e1750d492acb {{(pid=71500) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 16:29:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:29:52 user nova-compute[71500]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681489777.8300307, ac2b0997-a081-43e2-874f-6ae3da3ddd58 => Stopped> {{(pid=71500) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 16:29:52 user nova-compute[71500]: INFO nova.compute.manager [-] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] VM Stopped (Lifecycle Event)
Apr 14 16:29:52 user nova-compute[71500]: DEBUG nova.compute.manager [None req-54405d0b-f4b7-4aee-8d3a-6f6163326888 None None] [instance: ac2b0997-a081-43e2-874f-6ae3da3ddd58] Checking state {{(pid=71500) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 16:29:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:29:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:30:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:30:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:30:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:15 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:30:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:30:15 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 16:30:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:18 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:30:21 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:30:21 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=26.054988861083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:30:21 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:30:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:26 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:27 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:28 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:29 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:30:32 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:34 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:37 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:38 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:42 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:47 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:52 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:30:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:30:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:30:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:30:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:30:57 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:31:02 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:31:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:31:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:31:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71500) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 16:31:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:31:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71500) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 16:31:07 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:31:12 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:31:17 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:31:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Starting heal instance info cache {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 16:31:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Rebuilding the list of instances to heal {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 16:31:17 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Didn't find any instances for network info cache update. {{(pid=71500) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 16:31:17 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 16:31:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:31:19 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:31:19 user nova-compute[71500]: DEBUG nova.compute.manager [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71500) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 16:31:20 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:31:20 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:31:22 user nova-compute[71500]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71500) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_service.periodic_task [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71500) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Auditing locally available compute resources for user (node: user) {{(pid=71500) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 16:31:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:31:23 user nova-compute[71500]: WARNING nova.virt.libvirt.driver [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Hypervisor/Node resource view: name=user free_ram=8990MB free_disk=26.022109985351562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71500) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71500) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.compute.provider_tree [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed in ProviderTree for provider: 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 {{(pid=71500) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.scheduler.client.report [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Inventory has not changed for provider 7f2d4b4f-06b2-48b2-814e-7a5c8553e0a5 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71500) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG nova.compute.resource_tracker [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Compute_service record updated for user:user {{(pid=71500) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 16:31:23 user nova-compute[71500]: DEBUG oslo_concurrency.lockutils [None req-ade419cd-0f11-4c05-bba3-3d50fe2c0b30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=71500) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}